Microphone-connected live broadcast method and device across live broadcast platforms, and storage medium

Abstract

The invention relates to a microphone-connected live broadcast method and device across live broadcast platforms, and a storage medium, and the method comprises the steps: creating a virtual anchor account in a first live broadcast platform server, and pulling a live broadcast media stream of an anchor account of a second live broadcast platform from a second live broadcast platform server through loading a second platform real-time communication tool, and mapping the live broadcast media stream of the anchor account into the live broadcast media stream of the virtual anchor account of the first live broadcast platform, thereby realizing microphone-connected live broadcast of the anchor of the second live broadcast platform in the first live broadcast platform. And similarly, microphone-connected live broadcast of the anchor of the first live broadcast platform in the second live broadcast platform is realized in the second live broadcast platform server. According to the microphone-connected live broadcast method across the live broadcast platform, the microphone-connected live broadcast across the live broadcast platform can be realized only by performing related adjustment in the server without updating the application program of the live broadcast client, meanwhile, the high real-time performance of the microphone-connected live broadcast can be ensured, and the microphone-connected live broadcast effect across the live broadcast platform can be ensured.

Description

Technical Field

[0001] The present application relates to the technical field of network live broadcasting, and in particular to a method, device and storage medium for live broadcasting with microphones connected across live broadcasting platforms. Background Art

[0002] Live streaming is a technology that allows anchors to share live audio and video streams with viewers on the Internet through a live streaming platform. Live streaming is a new form of Internet business that reflects the open and shared characteristics of the Internet, giving every ordinary person the opportunity to showcase their talents on the Internet.

[0003] Currently, many live broadcast platforms have the function of live broadcast with microphones. Live broadcast with microphones refers to the host establishing a live broadcast session connection with other live broadcasters through the host terminal. After the live broadcast session connection is established, the host can have two-way audio and video interaction with other live broadcasters, so that the audience can watch the audio and video interaction process between the host and other live broadcasters. Live broadcast with microphones includes live broadcast with microphones for two people and live broadcast with microphones for multiple people. However, the existing live broadcast with microphones is generally limited to the hosts on the same live broadcast platform, lacks diversity, and the fun it brings to the audience is becoming increasingly limited. In this regard, live broadcast with microphones across live broadcast platforms can improve the richness and fun of live broadcast with microphones.

[0004] The complex Internet environment often causes network transmission delays. When there is a large delay in live broadcast, it will affect the interactive experience of live broadcast with microphones. In this regard, the live broadcast platform uses RTC (Real Time Communication) service to ensure the high real-time performance of live broadcast. RTC is a high-real-time communication network specially established on the public Internet. Compared with the transmission of the public Internet, it has higher real-time performance. It has become an audio and video infrastructure and is widely used in the field of online live broadcast.

[0005] However, the RTC services of different live broadcast platforms often use different communication protocols and are isolated from each other. In particular, some enterprises may use customized private transmission protocols to ensure the security of their RTC networks. The interaction and processing logic of the internal servers of different live broadcast platforms may also be very different. Therefore, there has not been a feasible solution for cross-platform live broadcast. Summary of the invention

[0006] Based on this, the purpose of this application is to provide a method for live broadcasting with microphones across live broadcast platforms, which realizes low-latency live broadcasting with microphones across live broadcast platforms and effectively improves the live broadcasting experience of the audience.

[0007] The first aspect of the embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, comprising the following steps:

[0008] The first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account of the first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account includes a first anchor account and a first virtual anchor account of the first live broadcast platform; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0009] The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account with microphones connected to the second live broadcast room with microphones connected, wherein the second live broadcast account with microphones connected includes a second anchor account and a second virtual anchor account of the second live broadcast platform; wherein the second virtual anchor account is bound to the first anchor account of the first live broadcast platform;

[0010] The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server;

[0011] The second anchor client loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server;

[0012] The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and pulls the second live broadcast media stream from the second live broadcast platform server by loading the second platform real-time communication tool, maps the second live broadcast media stream to the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the client;

[0013] The second live broadcast platform server receives the second live broadcast media stream as the live broadcast media stream of the second anchor account, and pulls the first live broadcast media stream from the first live broadcast platform server by loading the first platform real-time communication tool, maps the first live broadcast media stream to the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live media stream of the second virtual anchor account, and sends the second live broadcast media stream to the client that has joined the second live broadcast room.

[0014] A second aspect of an embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first live broadcast platform server and includes the following steps:

[0015] A first live broadcast room with microphones connected is created, and a first live broadcast account with microphones connected to the first live broadcast room is added to the first live broadcast room with microphones connected to the first live broadcast room, wherein the first live broadcast account with microphones connected to the first live broadcast platform includes a first anchor account and a first virtual anchor account; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0016] The first live media stream sent by the first anchor client is received as the live media stream of the first anchor account, and the second live media stream is pulled from the second live platform server by loading the second platform real-time communication tool, and the second live media stream is mapped to the live media stream of the first virtual anchor account; wherein, the first live media stream is generated by encoding the local original live media stream by the first anchor client by loading the first platform real-time communication tool, and the second live media stream is generated by encoding the local original live media stream by the second anchor client through the second platform real-time communication tool;

[0017] The live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a first live media stream with microphones connected, and the first live media stream with microphones connected is sent to a client that has joined the first live broadcast room with microphones connected.

[0018] A third aspect of an embodiment of the present application discloses a computer device, including a memory, a processor, and a computer program stored in the memory, wherein the computer program implements the steps of the method described in any one of the embodiments of the present application when executed by the processor.

[0019] A fourth aspect of an embodiment of the present application discloses a computer-readable storage medium on which a computer program is stored, characterized in that when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute a method as described in any one of the embodiments of the present application.

[0020] The method for live broadcasting with microphones across live broadcast platforms described in the embodiment of the present application creates a first virtual anchor account in the first live broadcast platform server, and loads the live media stream of the second anchor account of the second live broadcast platform pulled from the second live broadcast platform server through the real-time communication tool of the second platform, maps the live media stream of the second anchor account to the live media stream of the first virtual anchor account of the first live broadcast platform, generates a live broadcast media stream with microphones by combining the live media stream of the first virtual anchor account and the live media stream of the first anchor account of the first live broadcast platform, and sends it to the client that joins the first live broadcast room with microphones, thereby realizing the connection between the anchors of the first live broadcast platform and the second live broadcast platform The live broadcast with microphones in the first live broadcast platform; similarly, a second virtual anchor account is created in the server of the second live broadcast platform, and the live media stream of the first anchor account of the first live broadcast platform is pulled from the server of the first live broadcast platform by loading the real-time communication tool of the first platform, and the live media stream of the first anchor account is mapped to the live media stream of the second virtual anchor account of the second live broadcast platform, and the live media stream of the second virtual anchor account and the live media stream of the second anchor account are generated into a live broadcast with microphones and sent to the client that joins the second live broadcast with microphones, thereby realizing the live broadcast with microphones of the anchors of the first live broadcast platform and the second live broadcast platform in the second live broadcast platform. The method for live broadcast with microphones across live broadcast platforms described in the embodiment of the present application only needs to make relevant adjustments on the server without changing the live broadcast client, and does not require the anchor client or the audience client to update the live broadcast client application, so that live broadcast with microphones across live broadcast platforms can be realized, and at the same time, the high real-time performance of live broadcast with microphones can be guaranteed, and the live broadcast effect of live broadcast with microphones across live broadcast platforms can be guaranteed.

[0021] For better understanding and implementation, the present application is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A schematic diagram of an application scenario of the method for live broadcasting with microphones across live broadcast platforms according to an embodiment of the present application;

[0023] Figure 2 A schematic diagram of a live broadcast room interface of an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the process of a method for live broadcasting with microphones across live broadcast platforms according to an embodiment of the present application;

[0025] Figure 4 A schematic diagram of the flow of steps for streaming by the first live broadcast platform server in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of a flow chart of a method for live broadcasting with microphones across live broadcast platforms according to another embodiment of the present application;

[0027] Figure 6A schematic diagram of the structure of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0028] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0029] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0030] It should be understood that, although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" / "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determination".

[0031] Those skilled in the art will appreciate that the "client", "terminal", "terminal device", and "intelligent device" used in this application include both devices with wireless signal receivers, which are devices with only wireless signal receivers without transmission capabilities, and devices with receiving and transmitting hardware, which are devices with receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such devices may include: cellular or other communication devices such as personal computers and tablet computers, which have single-line displays or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service, personal communication system), which can combine voice, data processing, fax and / or data communication capabilities; PDA (Personal Digital Assistant, personal digital assistant), which may include a radio frequency receiver, pager, Internet / intranet access, web browser, notepad, calendar and / or GPS (Global Positioning System, global positioning system) receiver; conventional laptop and / or palmtop computers or other devices, which have and / or include a conventional laptop and / or palmtop computer or other device with and / or including a radio frequency receiver. The "client", "terminal", "terminal device" and "intelligent device" used herein may be portable, transportable, installed in a vehicle (air, sea and / or land), or suitable for and / or configured to run locally, and / or in a distributed form, at any other location on the earth and / or in space. The "client", "terminal", "terminal device" and "intelligent device" used herein may also be a communication terminal, an Internet terminal, a music / video playing terminal, such as a PDA, a MID (Mobile Internet Device) and / or a mobile phone with a music / video playing function, or may be a smart TV, a set-top box and other devices.

[0032] The hardware referred to by the names such as "server", "client", "service node", and "smart device" in this application is essentially a computer device with the equivalent capabilities of a personal computer. It is a hardware device with the necessary components revealed by the von Neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device. The computer program is stored in its memory, and the central processing unit calls the program stored in the external memory into the internal memory for execution, executes the instructions in the program, and interacts with the input and output devices to complete specific functions.

[0033] It should be pointed out that the concept of "server" referred to in this application can also be extended to the case of server clusters. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided. In physical space, these servers can be independent of each other but can be called through interfaces, or integrated into a physical computer or a set of computer clusters. Those skilled in the art should understand this flexibility, and should not use it to restrict the implementation of the network deployment method of this application.

[0034] Please refer to Figure 1 , Figure 1 A schematic diagram of an application scenario of the cross-live broadcast platform live broadcast method provided in an embodiment of the present application, wherein the application scenario includes the first live broadcast platform server 101 provided in an embodiment of the present application and the first anchor client 102 and the first audience client 103 logged in to the first live broadcast platform server 101, wherein the first anchor client 102 and the first audience client 103 interact through the first live broadcast platform server 101; and includes a second live broadcast platform server 201 and the second anchor client 202 and the second audience client 203 logged in to the second live broadcast platform server 201, wherein the second anchor client 202 and the second audience client 203 interact through the second live broadcast platform server 201.

[0035] Among them, the first anchor client 102 has a first anchor account registered in the first live broadcast platform server 101, and it can log in to the first anchor account through the first platform real-time communication tool and push or pull streams; the second anchor client 202 has a second anchor account registered in the second live broadcast platform server 201, and it can log in to the second anchor account through the second platform real-time communication tool and push or pull streams.

[0036] Among them, the first live broadcast platform server 101 communicates with the second live broadcast platform server 201 by loading the second platform real-time communication tool, and pulls the live media stream of the second anchor account from the second live broadcast platform server 201 through the second real-time communication tool; the second live broadcast platform server 201 communicates with the first live broadcast platform server 101 by loading the first platform real-time communication tool, and pulls the live media stream of the first anchor account from the first live broadcast platform server 101 through the first real-time communication tool.

[0037] In an embodiment of the present application, the real-time communication tool refers to a tool for communicating with a server in an RTC high real-time network, and specifically refers to a program module that can run a specific function to enable a computer device to enter the RTC network and communicate with the server, such as an RTC SDK (Software Development Kit). The first platform real-time communication tool refers to a tool for communicating with a first live broadcast platform server 101 in an RTC high real-time network of a first live broadcast platform, such as the RTC SDK of the first live broadcast platform; the second platform real-time communication tool refers to a tool for communicating with a second live broadcast platform server 201 in an RTC high real-time network of a second live broadcast platform, such as the RTC SDK of the second live broadcast platform.

[0038] Among them, the first anchor client 102 and the second anchor client 202 refer to the end that sends the live broadcast video, which is usually the client used by the anchor (ie, the live broadcast anchor user) in the live broadcast.

[0039] The first viewer client 103 and the second viewer client 203 refer to an end for receiving and viewing a live network video, and are generally the clients used by viewers (ie, live viewer users) who view the video in a live network video.

[0040] The hardware pointed to by the client is essentially a computer device, specifically, it can be a computer device of the type of a smart phone, a smart interactive tablet, a personal computer, etc. Each client can access the Internet through a well-known network access method and establish a data communication link with the server.

[0041] The first live broadcast platform server 101 and the second live broadcast platform server 201 may be business servers, each of which includes or is connected to the audio data server, video stream server and other servers providing related support for the first live broadcast platform and the second live broadcast platform, thereby forming a logically related service cluster to serve related terminal devices, such as Figure 1 Provides services to the various clients shown in .

[0042] In the embodiment of the present application, the host client and the audience client of the same live broadcast platform can join the live broadcast room (i.e., live broadcast channel) created by the corresponding live broadcast platform server. The above-mentioned live broadcast room refers to a chat room realized by Internet technology, which usually has audio and video broadcast control functions. The host user broadcasts live in the live broadcast room through the host client, and the audience of the audience client can log in to the live broadcast platform server to enter the live broadcast room to watch the live broadcast.

[0043] In the live broadcast room, the host and the audience can interact through known online interactive methods such as voice, video, and text. Generally, the host user performs programs for the audience in the form of audio and video streams, and can also generate behaviors during the interaction. Of course, the application form of the live broadcast room is not limited to online entertainment, but can also be extended to other related scenarios, such as: video conferencing scenarios, product promotion and sales scenarios, and any other scenarios that require similar interactions.

[0044] Specifically, the process of watching live broadcasts by viewers is as follows: viewers can click to access the live broadcast application installed on the viewer client, and choose to enter any live broadcast room, triggering the viewer client to load the live broadcast room interface for the viewer, and conduct various online interactions.

[0045] The first live broadcast platform server 101 and the second live broadcast platform server 201 are two independent network live broadcast platforms, such as the server of the first network live broadcast platform and the second network live broadcast platform.

[0046] The first live broadcast platform server 101 and the second live broadcast platform server 201 establish a network connection and perform data interaction through the network. The first live broadcast platform server 101 locally creates a first virtual anchor client 104 and a first virtual anchor account corresponding to the first virtual anchor client 104. The first virtual anchor client 104 is implemented by the first live broadcast platform server 101 through computational simulation, and the first virtual anchor account corresponding to it is an anchor account that can be logged in to the first live broadcast platform server 101. It should be noted that the virtual anchor client is essentially a program module that implements part or all of the functions (or similar functions) of a general anchor client, which is to enable the live broadcast platform server to conveniently maintain the virtual anchor account according to general procedures, such as the procedure of logging in to the anchor account, the procedure of pushing the stream, the procedure of authentication, etc. The specific steps performed by the virtual anchor client can be set according to the situation, for example, the virtual anchor client can simulate the issuance of a login request to log in to the virtual anchor account on the live broadcast platform server, and for example, the virtual anchor client can simulate the issuance of a push stream instruction to push the stream on the live broadcast platform server.

[0047] Please refer to Figure 2 , Figure 2This is a schematic diagram of the interface of a live broadcast room with microphones in an embodiment of the present application, which displays a live broadcast room with microphones 41 and a virtual anchor and a real anchor located in the live broadcast room with microphones 41. When live broadcasting with microphones is being conducted, the live broadcast media stream of the virtual anchor account and the live broadcast media stream of the real anchor account will be displayed in the live broadcast room with microphones 41. For example, in the live broadcast room of the first live broadcast platform of this embodiment, the live broadcast media stream of the first anchor account and the live media stream of the first virtual anchor account will be displayed.

[0048] When implementing cross-platform live broadcasting by anchors, the first live broadcast platform server 101 obtains the live broadcast media stream uploaded by the first anchor client 102 logged in on the platform. In addition, the first live broadcast platform server 101 obtains the second anchor account corresponding to the second anchor client 202 logged in by the second live broadcast platform server 201, and establishes a binding relationship between the second anchor account and the first virtual anchor account. The first live broadcast platform server 101 obtains the live broadcast media stream uploaded by the second anchor client 202 from the second live broadcast platform server 201 through the binding relationship, and maps the live broadcast media stream uploaded by the second anchor client 202 into the media stream of the first virtual anchor client 104 created locally, so that the second anchor client 202 logged in by the second live broadcast platform server 201 can perform live broadcast in the first live broadcast platform server 101 as the first virtual anchor client 104. The live media stream of the first virtual anchor client 104 can be set by the first live platform server 101 to be viewable / searchable individually or not viewable / searchable individually. In this embodiment, the first live platform server 101 sets the live media stream of the first virtual anchor client 104 to be not viewable / searchable individually, that is, the live media stream of the first virtual anchor client 104 can only be used for live broadcast with microphones connected.

[0049] When the live broadcast with microphones is turned on, the first live broadcast platform server 101 creates a live broadcast room with microphones, adds the first virtual anchor account and the first anchor account to the live broadcast room with microphones, receives the first live media stream sent by the first anchor client 102 as the live media stream of the first anchor account, and pulls the live media stream of the second anchor account from the second live broadcast platform server by loading the second platform real-time communication tool and maps it to the live media stream of the first virtual anchor account, generates the first live media stream with microphones by combining the live media stream of the first anchor account and the live media stream of the first virtual anchor account, and sends the first live media stream with microphones to the client that has joined the first live broadcast room with microphones. The second live broadcast platform server 201 is similar and will not be described in detail.

[0050] In one embodiment, the first live broadcast platform server 101 obtains the live broadcast media stream corresponding to the first anchor account and the live broadcast media stream corresponding to the first virtual anchor account, mixes the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account to obtain a mixed live broadcast media stream, and sends the mixed live broadcast media stream to the client that has joined the live broadcast room with microphones. Among them, the client that joins the live broadcast room with microphones created by the first live broadcast platform server 101 includes the first anchor client 102 and the first audience client 103 that log in to the first live broadcast platform. The second live broadcast platform server 201 is the same and will not be repeated.

[0051] Please refer to Figure 3 The embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, comprising the following steps:

[0052] S101: The first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account with microphones connected to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0053] S102: The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account of the second live broadcast platform to the second live broadcast room with microphones connected, wherein the second live broadcast account includes a second anchor account and a second virtual anchor account of the second live broadcast platform; wherein the second virtual anchor account is bound to the first anchor account of the first live broadcast platform;

[0054] S103: The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server;

[0055] S104: The second anchor client loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server;

[0056] S105: The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and pulls the second live broadcast media stream from the second live broadcast platform server by loading the second platform real-time communication tool, maps the second live broadcast media stream to the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the client;

[0057] S106: The second live broadcast platform server receives the second live broadcast media stream as the live broadcast media stream of the second anchor account, and pulls the first live broadcast media stream from the first live broadcast platform server by loading the first platform real-time communication tool, maps the first live broadcast media stream to the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live broadcast media stream of the second virtual anchor account, and sends the second live broadcast media stream with the microphone to the client that has joined the second live broadcast room with the microphone.

[0058] The method for live broadcasting with microphones across live broadcast platforms described in the embodiment of the present application creates a first virtual anchor account in the first live broadcast platform server, and loads the live media stream of the second anchor account of the second live broadcast platform pulled from the second live broadcast platform server through the real-time communication tool of the second platform, maps the live media stream of the second anchor account to the live media stream of the first virtual anchor account of the first live broadcast platform, generates a live broadcast media stream with microphones by combining the live media stream of the first virtual anchor account and the live media stream of the first anchor account of the first live broadcast platform, and sends it to the client that joins the first live broadcast room with microphones, thereby realizing the connection between the anchors of the first live broadcast platform and the second live broadcast platform The live broadcast with microphones in the first live broadcast platform; similarly, a second virtual anchor account is created in the server of the second live broadcast platform, and the live media stream of the first anchor account of the first live broadcast platform is pulled from the server of the first live broadcast platform by loading the real-time communication tool of the first platform, and the live media stream of the first anchor account is mapped to the live media stream of the second virtual anchor account of the second live broadcast platform, and the live media stream of the second virtual anchor account and the live media stream of the second anchor account are generated into a live broadcast with microphones and sent to the client that joins the second live broadcast with microphones, thereby realizing the live broadcast with microphones of the anchors of the first live broadcast platform and the second live broadcast platform in the second live broadcast platform. The method for live broadcast with microphones across live broadcast platforms described in the embodiment of the present application only needs to make relevant adjustments on the server without changing the live broadcast client, and does not require the anchor client or the audience client to update the live broadcast client application, so that live broadcast with microphones across live broadcast platforms can be realized, and at the same time, the high real-time performance of live broadcast with microphones can be guaranteed, and the live broadcast effect of live broadcast with microphones across live broadcast platforms can be guaranteed.

[0059] Below, the embodiments of the present application will explain the relevant steps from the perspective of the first live broadcast platform server and / or the first anchor client. The technical concepts embodied therein also correspond to the second live broadcast platform server and the second anchor client. The description of the relevant steps also applies to the second live broadcast platform server and the second anchor client, and will not be repeated here.

[0060] For step S101, the first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account of the first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account includes a first anchor account and a first virtual anchor account of the first live broadcast platform; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client.

[0061] Among them, the live broadcast room with connected microphones, including the first and second live broadcast rooms with connected microphones, essentially refers to a session connection established between two or more host clients with connected microphones that can perform two-way audio and video interaction. The establishment of such a session connection enables the two or more connected microphone hosts to be displayed together in the audience client and the audio and video interaction between the two or more hosts to be viewed. Specifically, from the perspective of the audience client, the live broadcast room with connected microphones may have only one entrance to the live broadcast room, and all users who watch the live broadcast room with connected microphones enter from the unified entrance, or the live broadcast room with connected microphones may have multiple different entrances to the live broadcast room, for example, each host with connected microphones has his own live broadcast room, and the live broadcast picture can be viewed by entering from any live broadcast room of the connected microphone host, that is, the live broadcast room with connected microphones is not limited to one room, and it may also be in various forms. As long as the live broadcast picture of the connected microphone can be viewed after entering the live broadcast room, the room should be considered to belong to the live broadcast room with connected microphones.

[0062] Specifically, there are various forms or methods for creating a live broadcast room with microphones, especially different live broadcast platforms may be different. For example, a live broadcast channel may be created, and two or more live broadcast accounts of the live broadcast may be pulled into the live broadcast channel. Then, when the live broadcast channel is started, the live broadcast media streams of the two or more live broadcast accounts in the live broadcast channel are obtained, thereby achieving the effect of two or more live broadcasts of the live broadcast; for example, the live broadcast channels of the live broadcast accounts of the live broadcasters may be bound to each other, such as binding the first live broadcast channel of the first live broadcast account with the second live broadcast channel of the second live broadcast account. When the live broadcast is carried out with microphones, the second live broadcast channel pulls the live broadcast media stream of the first live broadcast channel from the first live broadcast channel, and the first live broadcast channel pulls the live broadcast media stream of the second live broadcast channel from the second live broadcast channel, thereby achieving the effect of playing the live broadcast effect of the live broadcast on the first live broadcast channel and the second live broadcast channel respectively. In addition, live broadcast with microphones may be realized in various other forms. In this regard, the present application does not limit the method of creating a live broadcast room with microphones, and it should be considered that any suggested method of live broadcast with microphones without departing from the concept of the present application is within the scope of protection of the present application. Furthermore, it should be understood that in certain scenarios of creating a live broadcast room, when creating a live broadcast room with connected wheat, the live broadcast account with connected wheat is also pulled into the live broadcast room with connected wheat, that is to say, creating a live broadcast room with connected wheat and adding the live broadcast account with connected wheat to the live broadcast room can be a unified action, for example, binding the first live broadcast channel of the first anchor account with the second live broadcast channel of the second anchor account, and the establishment of this binding relationship is considered to have created a live broadcast room with connected wheat, then at the same time it is also equivalent to adding the live broadcast account with connected wheat (the first anchor account and the second anchor account) to the live broadcast room with connected wheat. In other scenarios, creating a live broadcast room with connected wheat and adding the live broadcast account with connected wheat to the live broadcast room can be separate actions, that is, the action of creating a live broadcast room with connected wheat can be performed first, and then the action of adding the live broadcast account with connected wheat to the live broadcast room can be performed, for example, first creating a live broadcast channel with connected wheat, and then binding the live broadcast account with connected wheat to the live broadcast channel with connected wheat. The aforementioned situations are all within the technical conception of the embodiments of the present application, and the detailed differences in the specific implementation methods should be considered to be within the protection scope of this step without departing from the technical conception of the present application.

[0063] Among them, the live broadcast account refers to the host account of the live broadcast, which may include several host accounts. In the cross-platform live broadcast method of this embodiment, the live broadcast accounts in the first live broadcast room include the first host account and the first virtual host account.

[0064] In the embodiment of the present application, the number of anchor accounts for live broadcasting with microphone connection is not limited, and two or more anchor accounts can be used for live broadcasting with microphone connection. In the present embodiment, the first anchor account and the first virtual anchor account are used for live broadcasting with microphone connection in the first live broadcasting platform server for illustration. In other embodiments, more anchor accounts can be used for live broadcasting with microphone connection. For example, the first anchor account can be one or more, and the first virtual anchor account can also be one or more. For the live broadcasting process of other anchor accounts, please refer to the live broadcasting process of the anchor account of the present embodiment.

[0065] The live media stream is the media data of the live broadcast by the host, which can be audio and video data, or only video data or only audio data. This application does not limit this and can be set or adjusted according to the live broadcast scenario.

[0066] In the embodiment of the present application, the anchor account, including the first anchor account and the second live broadcast account, is a real account registered by the anchor of the live broadcast platform on the platform, which is generally also the account used by the anchor to broadcast live or watch other people's live broadcasts on the platform; and the virtual anchor account, including the first virtual anchor account and the second virtual anchor account, is a virtual anchor account of the live broadcast platform created by the server of the live broadcast platform, and the virtual anchor account is bound to the real anchor account of other live broadcast platforms, and the live broadcast media stream of the client of the real anchor account of other live broadcast platforms is mapped to the live broadcast media stream of the virtual anchor account bound to the live broadcast platform, so that the real anchor account of other live broadcast platforms can be connected to the real anchor account of the live broadcast platform through the virtual live broadcast account created by the platform.

[0067] Specifically, registering an account generally requires initiating a registration request through a special interface provided by the live broadcast platform and undergoing a specific review process. However, in this embodiment, the virtual anchor account is not registered according to the general registration process, but is directly created in the live broadcast platform server. Of course, the virtual anchor account can also be registered by the anchor of the other platform according to the general registration process and created by the live broadcast platform server. The specific technical means of implementation can be adjusted according to the application scenario, and this application does not limit this.

[0068] Similarly, for step S102, the technical concept in the second live broadcast platform server is the same as that of step S101, which will not be elaborated here.

[0069] For step S103, the first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool, generates a first live media stream, and sends the first live media stream to the first live platform server.

[0070] The real-time communication tool has been explained in the application scenario of the embodiment of the present application. Specifically, in the present embodiment, it refers to the RTC SDK, and the first platform real-time communication tool refers to the RTC SDK of the first live broadcast platform.

[0071] The real-time communication tools of each live broadcast platform encode the original live broadcast media stream by converting the data according to the rules or format of the live broadcast platform.

[0072] In this embodiment, the original live media stream becomes an RTC live media stream after the encoding. The RTC live media stream can be transmitted with low latency in the RTC network of the live broadcast platform. After the first anchor client encodes the original live media stream through the real-time communication tool of the first platform, it can transmit the encoded RTC live media stream with low latency to the first live broadcast platform server.

[0073] In this embodiment, the first anchor client is installed with a first live broadcast client application of a first live broadcast platform, and a first anchor account is registered in the server of the first live broadcast platform, and the first anchor client can log in to the first anchor account in the first live broadcast client application and perform live broadcast; similarly, the second anchor client is installed with a second live broadcast client application of the second live broadcast platform, and a second anchor account is registered in the server of the second live broadcast platform, and the second anchor client can log in to the second anchor account in the second live broadcast client application and perform live broadcast.

[0074] Generally speaking, the software development kit (SDK) provided by the live broadcast platform is loaded into the live broadcast client application to realize specific functions. For example, the RTC SDK can provide functional modules for upper-layer services to call, and the upper-layer services call the RTCSDK by calling the application program interface (Application ProgramInterface, API) corresponding to the functional module of the RTCSDK, thereby realizing the corresponding business functions. For example, RTC communication with the live broadcast platform server can be realized by loading the RTC SDK of the live broadcast platform.

[0075] In this embodiment, the first anchor client loads the first platform real-time communication tool of the first live broadcast platform by loading the first live broadcast client application, so that the first platform real-time communication tool can be used to log in, subscribe, push and pull streams on the first live broadcast platform server; similarly, the second anchor client loads the second platform real-time communication tool of the second live broadcast platform by loading the second live broadcast client application, so that the second platform real-time communication tool can be used to log in, subscribe, push and pull streams on the second live broadcast platform server.

[0076] Specifically, the first platform real-time communication tool loaded by the first anchor client is configured with the RTC network communication codec protocol of the first live broadcast platform, so that the first platform real-time communication tool can be used to encode the original live media stream or decode the received RTC live media stream of the first live broadcast platform. The first platform real-time communication tool is generally also configured with the communication address information of the first live broadcast platform server, the first anchor account information (or the associated information of the first anchor account) and other related information (such as authentication information), so that the first platform real-time communication tool can communicate with the first live broadcast platform server. Similarly, the second platform real-time communication tool loaded in the second anchor client is configured with the RTC network communication codec protocol of the second live broadcast platform, and is generally also configured with the communication address information of the second live broadcast platform server, the second anchor account information (or the associated information of the second anchor account) and other related information (such as authentication information), so that the second platform real-time communication tool can communicate with the second live broadcast platform server.

[0077] As for step S104, the technical concept in the second anchor client is the same as that of step S103, and will not be described in detail here.

[0078] For step S105, the first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and pulls the second live broadcast media stream from the second live broadcast platform server by loading the second platform real-time communication tool, maps the second live broadcast media stream to the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with the microphone to the client that has joined the first live broadcast room with the microphone.

[0079] Specifically, when the first live broadcast platform server receives the first live broadcast media stream, it can determine that the first live broadcast media stream corresponds to the first anchor account by detecting the relevant information carried therein, and then use the first live broadcast media stream as the live broadcast media stream of the first anchor account; similarly, it can detect the relevant information carried in the second live broadcast media stream, determine that it corresponds to the first virtual anchor account, and then use the second live broadcast media stream as the live broadcast media stream of the first virtual anchor account.

[0080] In this embodiment, the first live broadcast platform server loads the second platform real-time communication tool of the second live broadcast platform, that is, the RTC SDK of the second live broadcast platform, so that the second live broadcast platform server can be subscribed to and pulled through the second platform real-time communication tool; similarly, the second live broadcast platform server loads the first platform real-time communication tool of the first live broadcast platform, that is, the RTC SDK of the first live broadcast platform, so that the first platform real-time communication tool can be subscribed to and pulled through the first platform real-time communication tool.

[0081] In other embodiments, when there are more than two live broadcast platforms, the live broadcast platform server is correspondingly loaded with real-time communication tools such as RTC SDK of each live broadcast platform connected to the microphone, and each real-time communication tool subscribes and pulls streams from the server of its own live broadcast platform respectively, so that each live broadcast platform server can obtain the live media stream of the anchor of each connected platform, thereby realizing live broadcast across multiple live broadcast platforms.

[0082] Specifically, the second platform real-time communication tool loaded by the first live broadcast platform server is configured with the RTC network communication codec protocol of the second live broadcast platform, so that the second platform real-time communication tool can be used to encode the original live media stream or decode the received second platform RTC live media stream. The second platform real-time communication tool is generally also configured with the communication address information of the second live broadcast platform server, the second platform live account information such as the second anchor account information (or the associated information of the second anchor account) and other relevant information (such as authentication information), so that the second platform real-time communication tool can communicate with the second live broadcast platform server. Furthermore, the second platform real-time communication tool can also be configured with the second platform live account information with the right to pull the stream, including the audience account or the anchor account, so that the account with the right to pull the stream can be used to pull the stream from the second live broadcast platform server. Similarly, the first platform real-time communication tool loaded in the second live broadcast platform server is configured with the RTC network communication codec protocol of the first live broadcast platform, and is generally also configured with the communication address information of the first live broadcast platform server, the first platform live broadcast account information such as the first anchor account information (or the associated information of the first anchor account) and other relevant information (such as authentication information), so that the first platform real-time communication tool can communicate with the first live broadcast platform server. Furthermore, the first platform real-time communication tool can also be configured with the first platform live broadcast account information with the permission to pull the stream, including the audience account or the anchor account, so that the account with the permission to pull the stream can be used to pull the stream from the first live broadcast platform server.

[0083] In one embodiment, the step of pulling the second live broadcast media stream from the second live broadcast platform server in step S105 includes:

[0084] Generate a subscription request through a second platform real-time communication tool, wherein the subscription request includes an account identifier of the second anchor account;

[0085] The subscription request is sent to the second live broadcast platform server, so that the second live broadcast platform server returns the second live broadcast media stream corresponding to the second anchor account in response to the subscription request.

[0086] In this embodiment, the first live broadcast platform server generates a subscription request by calling the second platform real-time communication tool, wherein the subscription request includes the account identifier of the anchor account of the second live broadcast platform to be subscribed, specifically the account identifier of the second anchor account in this embodiment. After the subscription request is sent to the second live broadcast platform server for successful subscription, the second live broadcast platform server will push the second live broadcast media stream corresponding to the second anchor account to the first live broadcast platform server.

[0087] In one embodiment, the first live broadcast platform server includes a business server and a media server, and the second live broadcast platform server includes a business server and a media server;

[0088] The method for live broadcasting with microphones across live broadcasting platforms described in the embodiment of the present application further includes the following steps:

[0089] The service server of the first live broadcast platform obtains the account identifier, broadcast channel information and verification information of the second anchor account from the service server of the second live broadcast platform;

[0090] The step of generating a subscription request through the second platform real-time communication tool and sending the subscription request to the second live broadcast platform server comprises:

[0091] The media server of the first live broadcast platform calls the real-time communication tool of the second platform to generate a subscription request according to the account identification of the second anchor account, the broadcast channel information and the verification information, and sends the subscription request to the media server of the second live broadcast platform. When the media server of the second live broadcast platform verifies that the verification information is legal, the live media stream of the corresponding broadcast channel of the second anchor account is returned according to the account identification of the second anchor account and the broadcast channel information.

[0092] In this embodiment, the first and second live broadcast platform servers are divided into multiple types of servers, generally including media servers, business servers, etc. Different servers have different divisions of labor. For example, the business server is responsible for handling such as microphone account management, establishing and managing broadcast channels, etc., and the media server is responsible for pulling, storing, and sending live media streams, etc. Therefore, the business server of the first live broadcast platform first obtains the relevant microphone live broadcast information including the account ID, broadcast channel information, and verification information of the second anchor account from the business server of the second live broadcast platform, and synchronizes it to the media server of the first live broadcast platform, so that the media server of the first live broadcast platform generates a subscription request based on the microphone live broadcast information, and subscribes to the media server of the second live broadcast platform to pull the live media stream of the corresponding broadcast channel of the second anchor account.

[0093] Among them, the verification information is information used to verify whether the subscription request is legal, which generally includes an authority identifier and / or a secret command and / or specific account information. In one embodiment, the verification information includes a second live broadcast platform account with the authority to pull the live media stream of the second live broadcast platform's connected microphone anchor account, and the second live broadcast platform account can be a viewer account or an anchor account of the second live broadcast platform. In this embodiment, the verification information includes a secret command and a viewer account with the authority to pull the live media stream of the second anchor account, and the verification information can specifically be token information. In this embodiment, when the second live broadcast platform server receives the verification information, it verifies whether the secret command is legal and whether the viewer account is legal and has the authority to pull the live media stream of the second anchor account. If the verification is passed, the corresponding live broadcast channel of the second anchor account is subscribed to the viewer account according to the account identifier and the broadcast channel information of the second anchor account, so that the live media stream of the corresponding broadcast channel of the second anchor account is pushed to the first live broadcast platform server, and the first live broadcast platform server receives the pushed live media stream through the second platform real-time communication tool. Of course, if the verification is not legal, the second live broadcast platform server cannot subscribe and will not push the live media stream of the corresponding broadcast channel of the second anchor account to the first live broadcast platform server.

[0094] In this step, the first live broadcast platform server pulls the second live broadcast media stream from the second live broadcast platform server by loading the second platform real-time communication tool. Correspondingly, the second live broadcast platform server also pulls the first live broadcast media stream of the first live broadcast platform by loading the first platform real-time communication tool.

[0095] Please refer to Figure 4 In one embodiment, the method for live broadcasting with microphones connected across live broadcast platforms further includes the steps of:

[0096] S107: The first live broadcast platform server sends the first live broadcast media stream to the second live broadcast platform server, so that the second live broadcast platform server receives the first live broadcast media stream through the first platform real-time communication tool and maps it to the live broadcast media stream of the second virtual anchor account of the second live broadcast platform, generates a live broadcast media stream with microphones connected, and sends the live broadcast media stream with microphones connected to the client of the live broadcast room with microphones connected that has joined the second live broadcast platform; wherein, the second virtual anchor account is bound to the first anchor account of the first live broadcast platform.

[0097] In this embodiment, the first live broadcast platform server also corresponds to the second live broadcast platform server that pulls the first live broadcast media stream through the first platform real-time communication tool, and maps the first live broadcast media stream to the live broadcast media stream of the second virtual anchor account of the second live broadcast platform, thereby performing live broadcast in the second live broadcast room of the second live broadcast platform.

[0098] In one embodiment, the step of sending the first live broadcast media stream to the second live broadcast platform server in step S107 includes:

[0099] After receiving the subscription request sent by the second live broadcast platform server, the first live broadcast platform server sends the first live broadcast media stream to the second live broadcast platform server in response to the subscription request; wherein the second live broadcast platform server generates the subscription request through the first platform real-time communication tool, and the subscription request includes the account identifier of the first anchor account.

[0100] In this embodiment, after receiving the subscription request sent by the second live broadcast platform server, the first live broadcast platform server responds to the subscription request and sends the first live broadcast media stream to the second live broadcast platform server. For the description of this embodiment, please refer to the corresponding embodiment in the above embodiment.

[0101] In one embodiment, the method for live broadcasting with microphones connected across live broadcast platforms further includes the steps of:

[0102] The service server of the first live broadcast platform obtains the account identifier, broadcast channel information and verification information of the first anchor account, and sends the account identifier, broadcast channel information and verification information of the first anchor account to the service server of the second live broadcast platform, so that the media server of the second live broadcast platform calls the real-time communication tool of the first platform to generate the subscription request according to the account identifier, broadcast channel information and verification information of the first anchor account;

[0103] After receiving the subscription request sent by the second live broadcast platform server, the step of sending the first live broadcast media stream to the second live broadcast platform server in response to the subscription request includes:

[0104] After receiving the subscription request sent by the media server of the second live broadcast platform, the media server of the first live broadcast platform verifies whether the verification information is legal. If it is legal, the first live broadcast media stream of the corresponding broadcast channel of the first anchor account is sent to the media server of the second live broadcast platform according to the account identifier of the first anchor account and the broadcast channel information.

[0105] In this embodiment, the service server of the second live broadcast platform first obtains the relevant live broadcast information including the account ID, broadcast channel information and verification information of the first anchor account from the service server of the first live broadcast platform, so that the media server of the second live broadcast platform generates a subscription request according to the live broadcast information, and subscribes to the media server of the first live broadcast platform to pull the live media stream of the corresponding broadcast channel of the first anchor account. For the description of this embodiment, please refer to the corresponding embodiment in the above embodiment.

[0106] In one embodiment, the step of pulling the second live broadcast media stream from the second live broadcast platform server and mapping it to the live broadcast media stream of the first virtual anchor account in step S105 includes:

[0107] The first live broadcast platform server receives the live media stream of the second anchor account through the second platform real-time communication tool, converts the live media stream of the second anchor account into a live media stream in the real-time communication format of the first platform, and maps the live media stream in the real-time communication format of the first platform to the live media stream of the first virtual anchor account.

[0108] In this embodiment, after the first live broadcast platform server receives the live broadcast media stream of the second anchor account through the second platform real-time communication tool, it is necessary to convert the live broadcast media stream of the second anchor account into an RTC live broadcast media stream in the real-time communication format of the first platform, and then map the converted RTC live broadcast media stream to the live broadcast media stream of the first virtual anchor account. The RTC live broadcast media stream converted into the real-time communication format of the first platform can be communicated and transmitted in the RTC network of the first live broadcast platform.

[0109] Correspondingly, in one embodiment, the step of sending the first live broadcast media stream to the second live broadcast platform server in step S107 includes:

[0110] The first live media stream is sent to the second live platform server, so that the second live platform server receives the first live media stream through the first platform real-time communication tool, converts the first live media stream into a live media stream in the real-time communication format of the second platform, and maps the live media stream in the real-time communication format of the second platform to the live media stream of the second virtual anchor account.

[0111] In this embodiment, after the second live broadcast platform server receives the live media stream of the first anchor account through the first platform real-time communication tool, it is necessary to convert the live media stream of the first anchor account into an RTC live media stream in the real-time communication format of the second platform, and then map the converted RTC live media stream to the live media stream of the second virtual anchor account. The RTC live media stream converted into the real-time communication format of the second platform can be communicated and transmitted in the RTC network of the second live broadcast platform.

[0112] In this step S105, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a live media stream with microphones connected, so that the live video with microphones connected can be played in the client according to the live media stream with microphones connected.

[0113] Among them, the live broadcast media stream with microphones can be two independent live broadcast media streams without mixing; or it can be a mixed live broadcast media stream generated by mixing. Specifically, after the mixing is completed in the first live broadcast platform server, the mixed live broadcast media stream with microphones can be sent to the client for playback, or the first live broadcast platform server can directly send the live media stream of the first anchor account and the live media stream of the first virtual anchor account directly to the client, so that the client can perform mixed stream playback.

[0114] In one embodiment, the step of generating a first live broadcast media stream with microphones from the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account in step S105, and sending the first live broadcast media stream with microphones to a client that has joined the first live broadcast room with microphones includes:

[0115] Mixing the live media stream of the first anchor account and the live media stream of the first virtual anchor account to obtain the first live media stream with microphones, and sending the first live media stream with microphones to the viewer client that has joined the first live broadcast room with microphones;

[0116] And / or, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are directly sent as the first live media stream of the connected microphone to the audience client that has joined the first live broadcast room with connected microphones, so that the audience client of the first live broadcast room with connected microphones mixes the live media stream of the first anchor account and the live media stream of the first virtual anchor account.

[0117] In this embodiment, the first live broadcast platform server may first mix the live media stream of the first anchor account and the live media stream of the first virtual anchor account, and then send the mixed live media stream to the viewer client that has joined the connected anchor room through the RTC network or CDN server, so that the viewer client can play it directly; or it may directly send the live media stream of the first anchor account and the live media stream of the first virtual anchor account to the viewer client through the RTC network or CDN server, and the viewer client will mix the streams and play them.

[0118] In another embodiment, the first anchor client plays the live broadcast through the following steps:

[0119] The first live broadcast platform server sends the live broadcast media stream of the first virtual anchor account to the first anchor client, so that the first anchor client receives the live broadcast media stream of the first virtual anchor account and mixes the live broadcast media stream of the first virtual anchor account with the local live broadcast media stream.

[0120] In this embodiment, the local live broadcast playback method of the first anchor client is different from that of the audience client. It only needs to pull the live media stream of other anchors connected to the microphone, and then mix it with the local live media stream for playback, without having to pull the live media stream that has been mixed from the first live broadcast platform server.

[0121] In an embodiment of the present application, the live broadcast platform server pulls the RTC live media stream of the connected microphone anchor from other live broadcast platform servers with low latency through the real-time communication tools of other live broadcast platforms, and also decodes the pulled RTC live media stream through the real-time communication tools.

[0122] In the above embodiment, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are RTC live media streams encoded from the original live media streams, and therefore need to be decoded first when mixing the streams.

[0123] Furthermore, considering that the environments of different anchor clients may be different, the live media streams collected by them may also have some differences, such as differences in original data formats, resolutions, and screen ratios. Therefore, in one embodiment, the step of generating the first live media stream with microphones connected by the live media stream of the first anchor account and the live media stream of the first virtual anchor account in step S105 includes:

[0124] Converting the live media stream of the first anchor account and the live media stream of the first virtual anchor account into live media streams in a format preset by the first platform respectively;

[0125] The live media stream of the first anchor account and the live media stream of the first virtual anchor account converted into a first platform preset format are used to generate a first live media stream with microphones connected.

[0126] In this embodiment, the first live broadcast platform server first converts the live media stream of the first anchor account and the live media stream of the first virtual anchor account into live media streams of the first platform preset format according to the format specification or other requirements of the first live broadcast platform, and then generates the first live broadcast media stream with microphones from the live media stream of the first anchor account and the live media stream of the first virtual anchor account converted into the first platform preset format. Specifically, it is necessary to perform decoding first and then format conversion. The converted data can be re-encoded into RTC live media stream so that it can be transmitted in the RTC network, or the converted data can be directly used for mixed stream generation of live broadcast media stream with microphones and sent to the audience client, which can be set according to needs.

[0127] For step S106, the technical concept in the second live broadcast platform server is the same as that of step S105, and will not be elaborated here.

[0128] Please refer to Figure 5 The embodiment of the present application also discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first live broadcast platform server and includes the following steps:

[0129] S201: creating a first live broadcast room with microphones connected, adding a first live broadcast account with microphones connected to a first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0130] S202: receiving a first live media stream sent by the first anchor client as a live media stream of the first anchor account, and pulling a second live media stream from the second live platform server by loading a second platform real-time communication tool, and mapping the second live media stream to the live media stream of the first virtual anchor account; wherein, the first live media stream is generated by encoding the local original live media stream by the first anchor client by loading the first platform real-time communication tool, and the second live media stream is generated by encoding the local original live media stream by the second anchor client by using the second platform real-time communication tool;

[0131] S203: Generate a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and send the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room.

[0132] The method for live broadcasting with microphones connected across live broadcast platforms described in this embodiment is protected from the execution perspective of the first live broadcast platform server. Its specific implementation refers to the steps disclosed in any of the above embodiments.

[0133] Please refer to Figure 6 The embodiment of the present application also discloses a computer device 301, including a memory 302, a processor 303, and a computer program 304 stored in the memory 302; when the processor 303 executes the computer program 304, the steps of the method described in any of the above embodiments are implemented.

[0134] Among them, the processor 303 may include one or more processing cores. The processor 303 uses various interfaces and lines to connect various parts in the computer device 301, and executes various functions and processes data of the computer device 301 by running or executing instructions, programs, code sets or instruction sets stored in the memory 302, and calling the data in the memory 302. Optionally, the processor 303 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programble Logic Array, PLA). The processor 303 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the touch display; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 303, and it can be implemented separately through a chip.

[0135] Among them, the memory 302 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 302 includes a non-transitory computer-readable storage medium. The memory 302 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 302 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 302 may also be optionally at least one storage device located away from the aforementioned processor 303.

[0136] The present application embodiment also discloses a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to perform the method described in any of the above embodiments. That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions to make a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) perform all or part of the steps of the method described in each embodiment of the present application. The computer program may include a computer program code, which may be in the form of source code, object code, executable file or some intermediate form, etc. The aforementioned storage medium includes: any entity or device capable of carrying a computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0137] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present application, and the present application is also intended to include such modifications and modifications.

Claims

1. A method for live broadcasting with microphones across live broadcast platforms, characterized in that: The following steps are involved: The first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account of the first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account includes a first anchor account and a first virtual anchor account of the first live broadcast platform; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client; The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account with microphones connected to the second live broadcast room with microphones connected, wherein the second live broadcast account with microphones connected includes a second anchor account and a second virtual anchor account of the second live broadcast platform; wherein the second virtual anchor account is bound to the first anchor account of the first live broadcast platform; The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server; The second anchor client loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server; The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and pulls the second live broadcast media stream from the second live broadcast platform server by loading the second platform real-time communication tool, maps the second live broadcast media stream to the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the client; The second live broadcast platform server receives the second live broadcast media stream as the live broadcast media stream of the second anchor account, and pulls the first live broadcast media stream from the first live broadcast platform server by loading the first platform real-time communication tool, maps the first live broadcast media stream to the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live media stream of the second virtual anchor account, and sends the second live broadcast media stream to the client that has joined the second live broadcast room.

2. A method for live broadcasting with microphones across live broadcast platforms, characterized in that: Applied to the first live broadcast platform server, including the following steps: A first live broadcast room with microphones connected is created, and a first live broadcast account with microphones connected to the first live broadcast room is added to the first live broadcast room with microphones connected to the first live broadcast room, wherein the first live broadcast account with microphones connected to the first live broadcast platform includes a first anchor account and a first virtual anchor account; wherein the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client; The first live media stream sent by the first anchor client is received as the live media stream of the first anchor account, and the second live media stream is pulled from the second live platform server by loading the second platform real-time communication tool, and the second live media stream is mapped to the live media stream of the first virtual anchor account; wherein, the first live media stream is generated by encoding the local original live media stream by the first anchor client by loading the first platform real-time communication tool, and the second live media stream is generated by encoding the local original live media stream by the second anchor client through the second platform real-time communication tool; The live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a first live media stream with microphones connected, and the first live media stream with microphones connected is sent to a client that has joined the first live broadcast room with microphones connected.

3. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: The step of pulling the second live broadcast media stream from the second live broadcast platform server includes: Generate a subscription request through the second platform real-time communication tool, wherein the subscription request includes the account identifier of the second anchor account; The subscription request is sent to the second live broadcast platform server, so that the second live broadcast platform server returns the second live broadcast media stream corresponding to the second anchor account in response to the subscription request.

4. The method for live broadcasting across live broadcast platforms according to claim 3, characterized in that: The first live broadcast platform server includes a business server and a media server, and the second live broadcast platform server includes a business server and a media server; Also includes the steps: The service server of the first live broadcast platform obtains the account identifier, broadcast channel information and verification information of the second anchor account from the service server of the second live broadcast platform; The step of generating a subscription request through the second platform real-time communication tool and sending the subscription request to the second live broadcast platform server comprises: The media server of the first live broadcast platform calls the real-time communication tool of the second platform to generate a subscription request according to the account identification of the second anchor account, the broadcast channel information and the verification information, and sends the subscription request to the media server of the second live broadcast platform. When the media server of the second live broadcast platform verifies that the verification information is legal, the live media stream of the corresponding broadcast channel of the second anchor account is returned according to the account identification of the second anchor account and the broadcast channel information.

5. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: The step of pulling the second live broadcast media stream from the second live broadcast platform server and mapping the second live broadcast media stream to the live broadcast media stream of the first virtual anchor account includes: The second live media stream is received through the second platform real-time communication tool, the second live media stream is converted into a live media stream in the first platform real-time communication format, and the live media stream in the first platform real-time communication format is mapped to the live media stream of the first virtual anchor account.

6. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: Also includes the steps: The first live broadcast media stream is sent to the second live broadcast platform server, so that the second live broadcast platform server receives the first live broadcast media stream through the real-time communication tool of the first platform and maps it to the live broadcast media stream of the second virtual anchor account of the second live broadcast platform, and generates a live broadcast media stream with microphones connected by the live media stream of the second virtual anchor account and the live media stream of the second anchor account of the second live broadcast platform, and sends the live broadcast media stream with microphones connected by the client of the second live broadcast room with microphones connected by the client that has joined the second live broadcast room of the second live broadcast platform; wherein, the second virtual anchor account is bound to the first anchor account of the first live broadcast platform.

7. The method for live broadcasting across live broadcast platforms according to claim 6, characterized in that: The step of sending the first live broadcast media stream to the second live broadcast platform server includes: After receiving the subscription request sent by the second live broadcast platform server, in response to the subscription request, the first live broadcast media stream is sent to the second live broadcast platform server; wherein, the second live broadcast platform server generates the subscription request through the first platform real-time communication tool, and the subscription request includes the account identifier of the first anchor account.

8. The method for live broadcasting across live broadcast platforms according to claim 7, characterized in that: The first live broadcast platform server includes a business server and a media server, and the second live broadcast platform server includes a business server and a media server; Also includes the steps: The service server of the first live broadcast platform obtains the account identifier, broadcast channel information and verification information of the first anchor account, and sends the account identifier, broadcast channel information and verification information of the first anchor account to the service server of the second live broadcast platform, so that the media server of the second live broadcast platform calls the real-time communication tool of the first platform to generate the subscription request according to the account identifier, broadcast channel information and verification information of the first anchor account; After receiving the subscription request sent by the second live broadcast platform server, the step of sending the first live broadcast media stream to the second live broadcast platform server in response to the subscription request includes: After receiving the subscription request sent by the media server of the second live broadcast platform, the media server of the first live broadcast platform verifies whether the verification information is legal. If it is legal, the first live broadcast media stream of the corresponding broadcast channel of the first anchor account is sent to the media server of the second live broadcast platform according to the account identifier of the first anchor account and the broadcast channel information.

9. The method for live broadcasting across live broadcast platforms according to claim 6, characterized in that: The step of sending the first live broadcast media stream to the second live broadcast platform server includes: The first live media stream is sent to the second live platform server, so that the second live platform server receives the first live media stream through the first platform real-time communication tool, converts the first live media stream into a live media stream in the real-time communication format of the second platform, and maps the live media stream in the real-time communication format of the second platform to the live media stream of the second virtual anchor account.

10. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: The step of generating a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sending the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room includes: Mixing the live media stream of the first anchor account and the live media stream of the first virtual anchor account to obtain the first live media stream with microphones, and sending the first live media stream with microphones to the viewer client that has joined the first live broadcast room with microphones; And / or, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are directly sent as the first live media stream of the connected microphone to the audience client that has joined the first live broadcast room with connected microphones, so that the audience client of the first live broadcast room with connected microphones mixes the live media stream of the first anchor account and the live media stream of the first virtual anchor account.

11. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: Also includes the steps: The live media stream of the first virtual anchor account is sent to the first anchor client, so that the first anchor client receives the live media stream of the first virtual anchor account and mixes the live media stream of the first virtual anchor account with the local live media stream.

12. A computer device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory, wherein the computer program implements the steps of the method according to any one of claims 1 to 11 when executed by the processor.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 11.

Images