Microphone-connected live broadcast method and device across live broadcast platforms, and storage medium

Abstract

The invention relates to a cross-live-broadcast-platform microphone-connected live broadcast method and device and a storage medium, and the method comprises the steps: loading a real-time communication tool of other microphone-connected live broadcast platforms in an anchor client of different microphone-connected live broadcast platforms, thereby achieving the push flow of other microphone-connected live broadcast platform servers; each live broadcast platform server obtains live broadcast media streams sent by anchor clients of the platform and other platforms, so that microphone-connected live broadcast media streams can be generated and issued to clients in microphone-connected live broadcast rooms of respective platforms; therefore, the effect that the anchor of the platform and the anchors of other platforms are in microphone-connected live broadcast in the live broadcast room of the platform is achieved. By adopting the microphone-connected live broadcast method across the live broadcast platform, the processing logic of the server does not need to be changed complexly, the server can basically run according to the original processing logic of the platform, meanwhile, the high real-time performance of microphone-connected live broadcast can be ensured, and the microphone-connected live broadcast effect across the live broadcast platform can be ensured.

Description

Technical Field

[0001] The present application relates to the technical field of network live broadcasting, and in particular to a method, device and storage medium for live broadcasting with microphones connected across live broadcasting platforms. Background Art

[0002] Live streaming is a technology that allows anchors to share live audio and video streams with viewers on the Internet through a live streaming platform. Live streaming is a new form of Internet business that reflects the open and shared characteristics of the Internet, giving every ordinary person the opportunity to showcase their talents on the Internet.

[0003] Currently, many live broadcast platforms have the function of live broadcast with microphones. Live broadcast with microphones refers to the host establishing a live broadcast session connection with other live broadcasters through the host terminal. After the live broadcast session connection is established, the host can have two-way audio and video interaction with other live broadcasters, so that the audience can watch the audio and video interaction process between the host and other live broadcasters. Live broadcast with microphones includes live broadcast with microphones for two people and live broadcast with microphones for multiple people. However, the existing live broadcast with microphones is generally limited to the hosts on the same live broadcast platform, lacks diversity, and the fun it brings to the audience is becoming increasingly limited. In this regard, live broadcast with microphones across live broadcast platforms can improve the richness and fun of live broadcast with microphones.

[0004] The complex Internet environment often causes network transmission delays. When there is a large delay in live broadcast, it will affect the interactive experience of live broadcast with microphones. In this regard, the live broadcast platform uses RTC (Real Time Communication) service to ensure the high real-time performance of live broadcast. RTC is a high-real-time communication network specially established on the public Internet. Compared with the transmission of the public Internet, it has higher real-time performance. It has become an audio and video infrastructure and is widely used in the field of online live broadcast.

[0005] However, the RTC services of different live broadcast platforms often use different communication protocols and are isolated from each other. In particular, some enterprises may use customized private transmission protocols to ensure the security of their RTC networks. The interaction and processing logic of the internal servers of different live broadcast platforms may also be very different. Therefore, there has not been a feasible solution for cross-platform live broadcast. Summary of the invention

[0006] Based on this, the purpose of this application is to provide a method for live broadcasting with microphones across live broadcast platforms, which realizes low-latency live broadcasting with microphones across live broadcast platforms and effectively improves the live broadcasting experience of the audience.

[0007] The first aspect of the embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, comprising the following steps:

[0008] The first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account with microphones connected to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0009] The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account with microphones connected to the second live broadcast room with microphones connected, wherein the second live broadcast account with microphones connected includes a second anchor account and a second virtual anchor account of the second live broadcast platform; the second virtual anchor account is bound to the first anchor account of the first live broadcast platform;

[0010] The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server;

[0011] The second anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a third live media stream, and sends the third live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a fourth live media stream, and sends the fourth live media stream to the second live platform server;

[0012] The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and receives the third live broadcast media stream as the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room;

[0013] The second live broadcast platform server receives the fourth live broadcast media stream as the live broadcast media stream of the second anchor account, and receives the second live broadcast media stream as the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live broadcast media stream of the second virtual anchor account, and sends the second live broadcast media stream to the client that has joined the second live broadcast room.

[0014] A second aspect of the embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first anchor client and includes the following steps:

[0015] Encode the local original live media stream by loading the first platform real-time communication tool to generate a first live media stream, and send the first live media stream to the first live platform server;

[0016] Encode the local original live media stream by loading the second platform real-time communication tool to generate a second live media stream, and send the second live media stream to the second live platform server;

[0017] The first live broadcast media stream is used to generate a first live broadcast media stream with a live broadcast media stream of a first virtual anchor account of the first live broadcast platform server, the first live broadcast media stream is used to be displayed in a first live broadcast room created by the first live broadcast platform server, and the first virtual anchor account is bound to a second anchor account of a second live broadcast platform;

[0018] The second live broadcast media stream is used to generate a live broadcast media stream of the second virtual anchor account of the second live broadcast platform server. The live broadcast media stream of the second virtual anchor account and the live broadcast media stream of the second anchor client of the second live broadcast platform server generate a second live broadcast media stream with microphones connected. The second live broadcast media stream with microphones connected is used to be displayed in the second live broadcast room with microphones connected created by the second live broadcast platform server.

[0019] The third aspect of the embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first live broadcast platform server and includes the following steps:

[0020] A first live broadcast room with microphones connected is created, and a first live broadcast account with microphones connected to the first live broadcast room with microphones connected is added to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0021] The first live media stream received from the first anchor client is the live media stream of the first anchor account, and the third live media stream received from the second anchor client is the live media stream of the first virtual anchor account; wherein the first live media stream is generated by encoding the local original live media stream by the first anchor client by loading the first platform real-time communication tool; and the third live media stream is generated by encoding the local original live media stream by the second anchor client by loading the first platform real-time communication tool;

[0022] The live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a first live media stream with microphones connected, and the first live media stream with microphones connected is sent to a client that has joined the first live broadcast room with microphones connected.

[0023] A fourth aspect of an embodiment of the present application discloses a computer device, including a memory, a processor, and a computer program stored in the memory, wherein the computer program implements the steps of the method described in any one of the embodiments of the present application when executed by the processor.

[0024] A fifth aspect of an embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute a method as described in any one of the embodiments of the present application.

[0025] The method for live broadcasting with microphones across live broadcast platforms described in the embodiment of the present application, in addition to loading the real-time communication tool of the first platform on the host client of the first live broadcast platform, also loads the real-time communication tool of the second platform, so that not only the first platform real-time communication tool can be used to push the stream to the first live broadcast platform server, but also the second platform real-time communication tool can be used to push the stream to the second live broadcast platform server. Similarly, in addition to loading the real-time communication tool of the second platform on the host client of the second live broadcast platform, also loads the real-time communication tool of the first platform, so that not only the second platform real-time communication tool can be used to push the stream to the second live broadcast platform server, but also the first platform real-time communication tool can be used to push the stream to the first live broadcast platform server. That is to say, the anchor client directly pushes the stream to the server of the other live broadcast platform connected to the microphone by loading the real-time communication tool of the other live broadcast platform connected to the microphone. After each live broadcast platform server obtains the live media stream sent by the anchor client of the respective platform and the other live broadcast platform connected to the microphone, it maps the live media stream of the other platform to the live media stream of the virtual anchor account of the present live broadcast platform through the created virtual anchor account, and then generates the live media stream connected to the microphone in the respective platform and sends it to the client in the live broadcast room of the respective platform, thereby achieving the effect of the anchor of the present platform and the anchor of other platforms connected to the microphone in the live broadcast room of the present platform. By adopting the cross-platform live broadcast method of connected microphone described in the embodiment of the present application, there is no need to make complex changes to the processing logic of the server, and the server can basically run according to the original processing logic of the platform. At the same time, since the anchor clients connected to the microphone all run the real-time communication tools of each platform at the same time, the local live media stream is encoded and directly transmitted to the server of each live broadcast platform for use in the connected microphone, so the high real-time performance of the live broadcast connected to the microphone can be guaranteed, and the live broadcast effect of connected microphone across live broadcast platforms can be guaranteed.

[0026] For better understanding and implementation, the present application is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 A schematic diagram of an application scenario of the method for live broadcasting with microphones across live broadcast platforms according to an embodiment of the present application;

[0028] Figure 2 A schematic diagram of a live broadcast room interface of an embodiment of the present application;

[0029] Figure 3 A schematic diagram of the process of a method for live broadcasting with microphones across live broadcast platforms according to an embodiment of the present application;

[0030] Figure 4 A flowchart of the steps before the first anchor client performs streaming in an embodiment of the present application;

[0031] Figure 5 A schematic diagram of a flow chart of a method for live broadcasting with microphones across live broadcast platforms according to another embodiment of the present application;

[0032] Figure 6 A schematic diagram of a flow chart of a method for live broadcasting with microphones connected across live broadcast platforms according to another embodiment of the present application;

[0033] Figure 7 A schematic diagram of the structure of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0034] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0035] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0036] It should be understood that, although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" / "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determination".

[0037] Those skilled in the art will appreciate that the "client", "terminal", "terminal device", and "intelligent device" used in this application include both devices with wireless signal receivers, which are devices with only wireless signal receivers without transmission capabilities, and devices with receiving and transmitting hardware, which are devices with receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such devices may include: cellular or other communication devices such as personal computers and tablet computers, which have single-line displays or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service, personal communication system), which can combine voice, data processing, fax and / or data communication capabilities; PDA (Personal Digital Assistant, personal digital assistant), which may include a radio frequency receiver, pager, Internet / intranet access, web browser, notepad, calendar and / or GPS (Global Positioning System, global positioning system) receiver; conventional laptop and / or palmtop computers or other devices, which have and / or include a conventional laptop and / or palmtop computer or other device with and / or including a radio frequency receiver. The "client", "terminal", "terminal device" and "intelligent device" used herein may be portable, transportable, installed in a vehicle (air, sea and / or land), or suitable for and / or configured to run locally, and / or in a distributed form, at any other location on the earth and / or in space. The "client", "terminal", "terminal device" and "intelligent device" used herein may also be a communication terminal, an Internet terminal, a music / video playing terminal, such as a PDA, a MID (Mobile Internet Device) and / or a mobile phone with a music / video playing function, or may be a smart TV, a set-top box and other devices.

[0038] The hardware referred to by the names such as "server", "client", "service node", and "smart device" in this application is essentially a computer device with the equivalent capabilities of a personal computer. It is a hardware device with the necessary components revealed by the von Neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device. The computer program is stored in its memory, and the central processing unit calls the program stored in the external memory into the internal memory for execution, executes the instructions in the program, and interacts with the input and output devices to complete specific functions.

[0039] It should be pointed out that the concept of "server" referred to in this application can also be extended to the case of server clusters. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided. In physical space, these servers can be independent of each other but can be called through interfaces, or integrated into a physical computer or a set of computer clusters. Those skilled in the art should understand this flexibility, and should not use it to restrict the implementation of the network deployment method of this application.

[0040] See also Figure 1 , Figure 1 A schematic diagram of an application scenario of the cross-live broadcast platform live broadcast method provided in an embodiment of the present application, wherein the application scenario includes the first live broadcast platform server 101 provided in an embodiment of the present application and the first anchor client 102 and the first audience client 103 logged in to the first live broadcast platform server 101, wherein the first anchor client 102 and the first audience client 103 interact through the first live broadcast platform server 101; and includes a second live broadcast platform server 201 and the second anchor client 202 and the second audience client 203 logged in to the second live broadcast platform server 201, wherein the second anchor client 202 and the second audience client 203 interact through the second live broadcast platform server 201.

[0041] Among them, the first anchor client 102 has a first anchor account registered in the first live broadcast platform server 101, and it can log in to the first anchor account through the first platform real-time communication tool and push or pull streams; the second anchor client 202 has a second anchor account registered in the second live broadcast platform server 201, and it can log in to the second anchor account through the second platform real-time communication tool and push or pull streams.

[0042] In addition, the first anchor client 102 is also loaded with a second platform real-time communication tool, and communicates with the second live broadcast platform server 201; the second anchor client 202 is also loaded with a first platform real-time communication tool, and communicates with the first live broadcast platform server 101. Specifically, a first virtual anchor account is created locally on the first live broadcast platform server 101, corresponding to the second anchor client 202, the first virtual anchor account is an anchor account that can be logged in on the first live broadcast platform server 101, and the second anchor client 202 logs in to the first virtual anchor account of the first live broadcast platform server 101 through the first platform real-time communication tool; a second virtual anchor account is created locally on the second live broadcast platform server 201, corresponding to the first anchor client 102, the second virtual anchor account is an anchor account that can be logged in on the second live broadcast platform server 201, and the first anchor client 102 logs in to the second virtual anchor account of the second live broadcast platform server 201 through the second platform real-time communication tool.

[0043] In an embodiment of the present application, the real-time communication tool refers to a tool used to communicate with a server in an RTC high real-time network, and specifically refers to a program module that can run a specific function to enable a computer device to enter the RTC network and communicate with the server, such as an RTC SDK. The first platform real-time communication tool refers to a tool used to communicate with the first live broadcast platform server 101 in the RTC high real-time network of the first live broadcast platform, such as the RTC SDK of the first live broadcast platform; the second platform real-time communication tool refers to a tool used to communicate with the second live broadcast platform server 201 in the RTC high real-time network of the second live broadcast platform, such as the RTC SDK of the second live broadcast platform.

[0044] Among them, the first anchor client 102 and the second anchor client 202 refer to the end that sends the live broadcast video, which is usually the client used by the anchor (ie, the live broadcast anchor user) in the live broadcast.

[0045] The first viewer client 103 and the second viewer client 203 refer to an end for receiving and viewing a live network video, and are generally the clients used by viewers (ie, live viewer users) who view the video in a live network video.

[0046] The hardware pointed to by the client is essentially a computer device, specifically, it can be a computer device of the type of a smart phone, a smart interactive tablet, a personal computer, etc. Each client can access the Internet through a well-known network access method and establish a data communication link with the server.

[0047] The first live broadcast platform server 101 and the second live broadcast platform server 201 may be business servers, each of which includes or is connected to the audio data server, video stream server and other servers providing related support for the first live broadcast platform and the second live broadcast platform, thereby forming a logically related service cluster to serve related terminal devices, such as Figure 1 Provides services to the various clients shown in .

[0048] In the embodiment of the present application, the host client and the audience client of the same live broadcast platform can join the live broadcast room (i.e., live broadcast channel) created by the corresponding live broadcast platform server. The above-mentioned live broadcast room refers to a chat room realized by Internet technology, which usually has audio and video broadcast control functions. The host user broadcasts live in the live broadcast room through the host client, and the audience of the audience client can log in to the live broadcast platform server to enter the live broadcast room to watch the live broadcast.

[0049] In the live broadcast room, the host and the audience can interact through known online interactive methods such as voice, video, and text. Generally, the host user performs programs for the audience in the form of audio and video streams, and can also generate behaviors during the interaction. Of course, the application form of the live broadcast room is not limited to online entertainment, but can also be extended to other related scenarios, such as: video conferencing scenarios, product promotion and sales scenarios, and any other scenarios that require similar interactions.

[0050] Specifically, the process of watching live broadcasts by viewers is as follows: viewers can click to access the live broadcast application installed on the viewer client, and choose to enter any live broadcast room, triggering the viewer client to load the live broadcast room interface for the viewer, and conduct various online interactions.

[0051] The first live broadcast platform server 101 and the second live broadcast platform server 201 are two independent network live broadcast platforms, such as the server of the first network live broadcast platform and the second network live broadcast platform.

[0052] Please refer to Figure 2 , Figure 2 This is a schematic diagram of the interface of a live broadcast room with microphones in an embodiment of the present application, which displays a live broadcast room with microphones 41 and a virtual anchor and a real anchor located in the live broadcast room with microphones 41. When live broadcasting with microphones is being conducted, the live broadcast media stream of the virtual anchor account and the live broadcast media stream of the real anchor account will be displayed in the live broadcast room with microphones 41. For example, in the live broadcast room of the first live broadcast platform of this embodiment, the live broadcast media stream of the first anchor account and the live media stream of the first virtual anchor account will be displayed.

[0053] When implementing cross-platform live broadcasting by anchors, the first live broadcasting platform server 101 receives the first live broadcasting media stream uploaded by the first anchor client 102 logged in on the platform as the live broadcasting media stream of the first anchor account, and receives the third live broadcasting media stream uploaded by the second anchor client 202 logged in on the platform as the live broadcasting media stream of the first virtual anchor account. The second live broadcasting platform server receives the fourth live broadcasting media stream uploaded by the second anchor client 202 logged in on the platform as the live broadcasting media stream of the second anchor account, and receives the second live broadcasting media stream uploaded by the first anchor client 102 logged in on the platform as the live broadcasting media stream of the second virtual anchor account.

[0054] Therefore, the second anchor client 202 corresponding to the second anchor account of the second live broadcast platform server 201 can also perform live broadcast in the first live broadcast platform server 101 as the first virtual anchor account, and the first anchor client 102 corresponding to the first anchor account of the first live broadcast platform server 101 can also perform live broadcast in the second live broadcast platform server 201 as the second virtual anchor account.

[0055] The live media stream of the first virtual anchor account can be set by the first live platform server 101 to be viewable / searchable individually or not viewable / searchable individually. In this embodiment, the first live platform server 101 sets the live media stream of the first virtual anchor account to be not viewable / searchable individually, that is, the live media stream of the first virtual anchor account can only be used for live broadcast with microphones connected.

[0056] When the anchors of the first live broadcast platform and the second live broadcast platform are broadcasting live together, the first live broadcast platform server 101 creates a live broadcast room, receives the live media stream of the first anchor account uploaded by the first anchor client 102, and receives the live media stream of the first virtual anchor account uploaded by the second anchor client 202, and broadcasts the live media stream of the first anchor account and the live media stream of the first virtual anchor account together in the live broadcast room. The second live broadcast platform server 201 is similar and will not be described in detail.

[0057] In one embodiment, the first live broadcast platform server 101 obtains the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, mixes the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account to obtain a mixed live broadcast media stream, and sends the mixed live broadcast media stream to the client that has joined the live broadcast room with microphones. Among them, the client that joins the live broadcast room with microphones created by the first live broadcast platform server 101 may include the first anchor client 102 and / or the first audience client 103 that log in to the first live broadcast platform. The second live broadcast platform server 201 is similar and will not be described in detail.

[0058] Please refer to Figure 3 The embodiment of the present application discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is characterized by comprising the following steps:

[0059] S101: A first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account with microphones connected to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected to the first live broadcast room includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0060] S102: The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account with microphones connected to the second live broadcast room with microphones connected, wherein the second live broadcast account with microphones connected includes a second anchor account and a second virtual anchor account of the second live broadcast platform; the second virtual anchor account is bound to the first anchor account of the first live broadcast platform;

[0061] S103: The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server;

[0062] S104: The second anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a third live media stream, and sends the third live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a fourth live media stream, and sends the fourth live media stream to the second live platform server;

[0063] S105: The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and receives the third live broadcast media stream as the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room;

[0064] S106: The second live broadcast platform server receives the fourth live broadcast media stream as the live broadcast media stream of the second anchor account, and receives the second live broadcast media stream as the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live broadcast media stream of the second virtual anchor account, and sends the second live broadcast media stream with the microphone to the client that has joined the second live broadcast room.

[0065] The method for live broadcasting with microphones across live broadcast platforms described in the embodiment of the present application, in addition to loading the real-time communication tool of the first platform on the host client of the first live broadcast platform, also loads the real-time communication tool of the second platform, so that not only the first platform real-time communication tool can be used to push the stream to the first live broadcast platform server, but also the second platform real-time communication tool can be used to push the stream to the second live broadcast platform server. Similarly, in addition to loading the real-time communication tool of the second platform on the host client of the second live broadcast platform, also loads the real-time communication tool of the first platform, so that not only the second platform real-time communication tool can be used to push the stream to the second live broadcast platform server, but also the first platform real-time communication tool can be used to push the stream to the first live broadcast platform server. That is to say, the anchor client directly pushes the stream to the server of the other live broadcast platform connected to the microphone by loading the real-time communication tool of the other live broadcast platform connected to the microphone. After each live broadcast platform server obtains the live media stream sent by the anchor client of the respective platform and the other live broadcast platform connected to the microphone, it maps the live media stream of the other platform to the live media stream of the virtual anchor account of the present live broadcast platform through the created virtual anchor account, and then generates the live media stream connected to the microphone in the respective platform and sends it to the client in the live broadcast room of the respective platform, thereby achieving the effect of the anchor of the present platform and the anchor of other platforms connected to the microphone in the live broadcast room of the present platform. By adopting the cross-platform live broadcast method of connected microphone described in the embodiment of the present application, there is no need to make complex changes to the processing logic of the server, and the server can basically run according to the original processing logic of the platform. At the same time, since the anchor clients connected to the microphone all run the real-time communication tools of each platform at the same time, the local live media stream is encoded and directly transmitted to the server of each live broadcast platform for use in the connected microphone, so the high real-time performance of the live broadcast connected to the microphone can be guaranteed, and the live broadcast effect of connected microphone across live broadcast platforms can be guaranteed.

[0066] Below, the embodiments of the present application will explain the relevant steps from the perspective of the first live broadcast platform server and / or the first anchor client. The technical concepts embodied therein also correspond to the second live broadcast platform server and the second anchor client. The description of the relevant steps also applies to the second live broadcast platform server and the second anchor client, and will not be repeated here.

[0067] For step S101, the first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account of the first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client.

[0068] Among them, the live broadcast room with connected wheat, including the first and second live broadcast rooms with connected wheat, essentially refers to a session connection established between two or more host clients with connected wheat, which can perform two-way audio and video interaction. The establishment of such a session connection enables the two or more connected wheat hosts to be displayed together in the audience client and the audio and video interaction between the two or more hosts can be viewed. Specifically, from the perspective of the audience client, the live broadcast room with connected wheat can have only one live broadcast room entrance, and all users who watch the live broadcast room with connected wheat enter from the unified live broadcast room entrance, or the live broadcast room with connected wheat can also have multiple different live broadcast room entrances, for example, each host with connected wheat has his own live broadcast room, and the live broadcast picture can be seen from any live broadcast room of the connected wheat host, that is, the live broadcast room with connected wheat is not limited to one live broadcast room, it can also be in various forms, as long as the live broadcast picture of the connected wheat can be viewed after entering the live broadcast room, it should be considered that the live broadcast room belongs to the live broadcast room with connected wheat.

[0069] Specifically, there are various forms or methods for creating a live broadcast room with microphones, especially different live broadcast platforms may be different. For example, a live broadcast channel may be created, and two or more live broadcast accounts of the live broadcast may be pulled into the live broadcast channel. Then, when the live broadcast channel is started, the live broadcast media streams of the two or more live broadcast accounts in the live broadcast channel are obtained, thereby achieving the effect of two or more live broadcasts of the live broadcast; for example, the live broadcast channels of the live broadcast accounts of the live broadcasters may be bound to each other, such as binding the first live broadcast channel of the first live broadcast account with the second live broadcast channel of the second live broadcast account. When the live broadcast is carried out with microphones, the second live broadcast channel pulls the live broadcast media stream of the first live broadcast channel from the first live broadcast channel, and the first live broadcast channel pulls the live broadcast media stream of the second live broadcast channel from the second live broadcast channel, thereby achieving the effect of playing the live broadcast effect of the live broadcast on the first live broadcast channel and the second live broadcast channel respectively. In addition, live broadcast with microphones may be realized in various other forms. In this regard, the present application does not limit the method of creating a live broadcast room with microphones. It should be considered that any method of establishing live broadcast with microphones without departing from the concept of the present application is within the scope of protection of the present application. Furthermore, it should be understood that in certain scenarios of creating a live broadcast room, when creating a live broadcast room with connected wheat, the live broadcast account with connected wheat is also pulled into the live broadcast room with connected wheat, that is to say, creating a live broadcast room with connected wheat and pulling the live broadcast account with connected wheat into the live broadcast room with connected wheat can be a unified action, for example, binding the first live broadcast channel of the first anchor account with the second live broadcast channel of the second anchor account, and the establishment of such a binding relationship is considered to have created a live broadcast room with connected wheat, then at the same time it is also equivalent to pulling the live broadcast account with connected wheat (the first anchor account and the second anchor account) into the live broadcast room with connected wheat. In other scenarios, creating a live broadcast room with connected wheat and pulling the live broadcast account with connected wheat into the live broadcast room with connected wheat can be separate actions, that is, the action of creating a live broadcast room with connected wheat can be performed first, and then the action of pulling the live broadcast account with connected wheat into the live broadcast room can be performed, for example, first creating a live broadcast channel with connected wheat, and then binding the live broadcast account with connected wheat to the live broadcast channel with connected wheat. The aforementioned situations are all within the technical conception of the embodiments of the present application, and the detailed differences in the specific implementation methods should be considered to be within the protection scope of this step without departing from the technical conception of the present application.

[0070] Among them, the live broadcast account refers to the host account of the live broadcast, which may include several host accounts. In the cross-platform live broadcast method of this embodiment, the live broadcast accounts in the first live broadcast room include the first host account and the first virtual host account.

[0071] In the embodiment of the present application, the number of anchor accounts for live broadcasting with microphone connection is not limited, and two or more anchor accounts can be used for live broadcasting with microphone connection. In the present embodiment, the first anchor account and the first virtual anchor account are used for live broadcasting with microphone connection in the first live broadcasting platform server for illustration. In other embodiments, more anchor accounts can be used for live broadcasting with microphone connection. For example, the first anchor account can be one or more, and the first virtual anchor account can also be one or more. For the live broadcasting process of other anchor accounts, please refer to the live broadcasting process of the anchor account of the present embodiment.

[0072] The live media stream is the media data of the live broadcast by the host, which can be audio and video data, or only video data or only audio data. This application does not limit this and can be set or adjusted according to the live broadcast scenario.

[0073] In the embodiment of the present application, the anchor account, including the first anchor account and the second live broadcast account, is a real account registered by the anchor of the live broadcast platform on the platform, which is generally also the account used by the anchor to broadcast live or watch other people's live broadcasts on the platform; and the virtual anchor account, including the first virtual anchor account and the second virtual anchor account, is a virtual anchor account of the live broadcast platform created by the live broadcast platform server, and the virtual anchor account is bound to the real anchor account of other live broadcast platforms, and the live media stream of the client of the real anchor account of other live broadcast platforms is mapped to the live media stream of the virtual anchor account bound to the live broadcast platform, so that the real anchor account of other live broadcast platforms can be connected to the real anchor account of the live broadcast platform through the virtual live broadcast account created by the platform.

[0074] Specifically, registering an account generally requires initiating a registration request through a special interface provided by the live broadcast platform and undergoing a specific review process. However, in this embodiment, the virtual anchor account is not registered according to the general registration process, but is directly created in the live broadcast platform server. Of course, the virtual anchor account can also be registered by the anchor of the other platform according to the general registration process and created by the live broadcast platform server. The specific technical means of implementation can be adjusted according to the application scenario, and this application does not limit this.

[0075] In this embodiment, the first anchor client is installed with a first live broadcast client application of a first live broadcast platform, and a first anchor account is registered in the server of the first live broadcast platform, and the first anchor client can log in to the first anchor account in the first live broadcast client application and perform live broadcast; the second anchor client is installed with a second live broadcast client application of the second live broadcast platform, and a second anchor account is registered in the server of the second live broadcast platform, and the second anchor client can log in to the second anchor account in the second live broadcast client application and perform live broadcast.

[0076] Generally speaking, the live broadcast client application is loaded with the software development kit (SDK) provided by the live broadcast platform to realize specific functions. For example, RTC SDK can provide functional modules for upper-layer services to call, and the upper-layer services call the RTCSDK by calling the application program interface (Application ProgramInterface, API) corresponding to the functional module of RTCSDK, thereby realizing the corresponding business functions. For example, the real-time communication tool (RTC SDK) of the live broadcast platform can be loaded to realize RTC communication with the live broadcast platform server.

[0077] In this embodiment, the first anchor client loads the first platform real-time communication tool of the first live broadcast platform, that is, the RTC SDK of the first live broadcast platform, by loading the first live broadcast client application, so that the first platform real-time communication tool can be used to log in, subscribe, push and pull streams on the first live broadcast platform server; the second anchor client loads the second platform real-time communication tool of the second live broadcast platform, that is, the RTC SDK of the second live broadcast platform, by loading the second live broadcast client application, so that the second platform real-time communication tool can be used to log in, subscribe, push and pull streams on the second live broadcast platform server.

[0078] On this basis, in this embodiment, the first anchor client also loads the second platform real-time communication tool of the second live broadcast platform, that is, the RTC SDK of the second live broadcast platform, when loading the first live broadcast client application, so that the second platform real-time communication tool can be used to push and pull streams to the second live broadcast platform server (in this embodiment, it is mainly to push streams but not to pull streams, of course, in other embodiments, it is also possible to pull streams); similarly, when the second anchor client loads the second live broadcast client application, it also loads the first platform real-time communication tool of the first live broadcast platform, that is, the RTC SDK of the first live broadcast platform, so that the first platform real-time communication tool can be used to push and pull streams to the first live broadcast platform server (in this embodiment, it is mainly to push streams but not to pull streams, of course, in other embodiments, it is also possible to pull streams).

[0079] In one embodiment, the second platform real-time communication tool can be pushed by the first live broadcast platform server to the anchor client that needs to conduct cross-platform live broadcast. The pushing method can be to push the second platform real-time communication tool separately or directly package it in the live broadcast client application upgrade package or installation package of the live broadcast platform and push it.

[0080] Of course, in other embodiments, when there are more than two live broadcast platforms, correspondingly, real-time communication tools such as RTC SDK of each live broadcast platform connected to the microphone are loaded in the live broadcast client application of the connected host client, and each real-time communication tool pushes the stream to the server of its own live broadcast platform respectively, so that each live broadcast platform server can obtain the live media stream of the host of each connected platform, thereby realizing connected live broadcast across multiple live broadcast platforms.

[0081] In an embodiment of the present application, when conducting a live broadcast across live broadcast platforms, real-time communication tools of two or more different live broadcast platforms in the host client of the connected microphone, such as RTC SDK, run simultaneously, and encode the host's original live broadcast media stream respectively. The host client pushes the live broadcast media stream encoded by the real-time communication tools of each platform to the corresponding live broadcast platform server.

[0082] More specifically, the first platform real-time communication tool in the first anchor client is configured with the RTC network communication codec protocol of the first live broadcast platform for encoding the original live media stream or decoding the received RTC live media stream, and is generally also configured with the communication address information of the first live broadcast platform server, the first anchor account information (or the associated information of the first anchor account) and other relevant information (such as authentication information), so that the first platform real-time communication tool can communicate with the first live broadcast platform server; the second platform real-time communication tool loaded in the first anchor client is also configured with the communication address information of the second live broadcast platform server, the second virtual anchor account information (or the associated information of the second virtual anchor account) and other relevant information (such as authentication information), so that the second platform real-time communication tool can communicate with the second live broadcast platform server.

[0083] Similarly, for step S102, the technical concept in the second anchor client is the same as that of step S101, which will not be described here.

[0084] For step 103, the first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server.

[0085] The real-time communication tool has been explained in the application scenario of the embodiment of the present application. Specifically, in the present embodiment, it refers to the RTC SDK, and the first platform real-time communication tool refers to the RTC SDK of the first live broadcast platform.

[0086] The encoding of the original live media stream by the real-time communication tools of each live platform is to convert the data according to the rules or format of the live platform.

[0087] In this embodiment, the original live media stream becomes an RTC live media stream after the encoding. The RTC live media stream can be transmitted with low latency in the RTC network of the live broadcast platform. After the first anchor client encodes the original live media stream through the first platform real-time communication tool and the second platform real-time communication tool respectively, it can transmit the encoded live media stream with low latency to the first live broadcast platform server and the second live broadcast platform server respectively.

[0088] Please refer to Figure 4 In one embodiment, before the step of encoding the local original live media stream by loading the first platform real-time communication tool to generate the first live media stream and sending the first live media stream to the first live platform server in step S103, the step further includes:

[0089] Step S1032: the first anchor client receives a first microphone connection instruction sent by the first live broadcast platform server, wherein the first microphone connection instruction includes a first microphone connection live broadcast room identifier; and joins the first microphone connection live broadcast room according to the first microphone connection live broadcast room identifier.

[0090] In this embodiment, when the first anchor client receives the first microphone connection instruction sent by the first live broadcast platform server, it joins the first microphone connection live broadcast room according to the first microphone connection live broadcast room identifier. Specifically, when the first anchor client receives the first microphone connection live broadcast room identifier, it can display the live broadcast room microphone connection information on the operation interface of the live broadcast client application, and when receiving the confirmation instruction triggered by the user, it sends a confirmation instruction to the first live broadcast platform server, so that the first live broadcast platform server adds the first anchor account to the first microphone connection live broadcast room.

[0091] In one embodiment, the step of joining the live broadcast room according to the first live broadcast room identifier in step S1032 includes:

[0092] Parsing the first microphone connection instruction, and determining whether the current time reaches the preset microphone connection start time or is within the microphone connection start time period, if yes, entering the first microphone connection live broadcast room, otherwise not entering the first microphone connection live broadcast room; wherein the first microphone connection instruction also includes the preset microphone connection start time or the microphone connection start time period;

[0093] Or, parse the first microphone connection instruction, obtain the first microphone connection live broadcast room identifier, and directly join the first microphone connection live broadcast room.

[0094] In this embodiment, the first microphone connection instruction may not directly trigger the first anchor client to join the first microphone connection live broadcast room, and may further include the preset microphone connection start time or microphone connection start time period, so that the first anchor client determines whether the current time reaches the preset microphone connection start time or is within the microphone connection start time period, and if so, enters the first microphone connection live broadcast room, otherwise does not enter the first microphone connection live broadcast room; or the first microphone connection instruction may also directly trigger the first anchor client to join the first microphone connection live broadcast room, without including the preset microphone connection start time or microphone connection start time period.

[0095] In this embodiment, when the anchor client joins the live broadcast room, the live broadcast is started. At this time, the anchor client encodes the local original live media stream to generate a live media stream and sends the encoded live media stream to the corresponding live broadcast platform server. Specifically, the first anchor client sends the first live media stream to the first live broadcast platform server; and sends the second live media stream to the second live broadcast platform server. In other embodiments, when the anchor client joins the live broadcast room, it may not immediately start the live broadcast, but only start the live broadcast when it further receives the broadcast start instruction sent by the live broadcast platform server.

[0096] In another embodiment, the first microphone connection instruction may further include account information of the host of other platforms connected to the microphone, so that when the first host client pushes the stream to the server of other platforms connected to the microphone according to the account information, the server of other platforms can recognize the corresponding or bound host account.

[0097] In one embodiment, before the step of receiving the first microphone connection instruction sent by the first live broadcast platform server in step S1032, the following steps are included:

[0098] Step S1031: The first anchor client receives the live broadcast information sent by the first live broadcast platform server, where the live broadcast information includes the second virtual anchor account information;

[0099] After the step of receiving the first microphone connection instruction from the first live broadcast platform server in step S1032, the following steps are included:

[0100] Step S1033: the first anchor client generates a login instruction according to the live broadcast information through the second platform real-time communication tool, and sends the login instruction to the second live broadcast platform server, so that the second live broadcast platform server sets the second virtual anchor account to the logged-in state.

[0101] In this embodiment, the live broadcast information with microphones is used to log in to the anchor account of the other platform anchor connected to the microphone, and may specifically include the corresponding anchor account information, such as the second virtual anchor account information, and may also include other necessary information such as authentication information, which is specifically determined according to the live broadcast scenario of the live broadcast platform. Among them, the second virtual anchor account information may specifically be the account identifier and / or other relevant information of the second virtual anchor account. In this embodiment, the live broadcast information with microphones includes the account information of the second virtual anchor. The first anchor client receives the live broadcast information with microphones sent by the first live broadcast platform server before the live broadcast with microphones is started. Therefore, when the live broadcast with microphones is started, a login instruction is first generated according to the live broadcast information with microphones, and the login instruction is sent to the second live broadcast platform server. After the second live broadcast platform server completes the login to the second virtual anchor account, it can push the stream and push the encoded live media stream to the second virtual anchor account.

[0102] In one embodiment, the live broadcast information also includes the communication address information of the second live broadcast platform server; the communication address information is obtained by the first live broadcast platform server from the first live broadcast whitelist; the first anchor client sends the login instruction to the second live broadcast platform server according to the communication address information.

[0103] In this embodiment, the first live broadcast platform server is provided with a first microphone whitelist, which is used to store the communication address information of the servers of other live broadcast platforms connected to the microphone, such as the server IP address. When a cross-live broadcast is to be carried out, the communication address information corresponding to the server of the live broadcast platform connected to the microphone is obtained from the first microphone whitelist and given to the first anchor client, so that it can initiate streaming to the live broadcast platform server connected to the microphone according to the communication address information. In this embodiment, the first microphone whitelist is a data table established and maintained in the first live broadcast platform server. In other embodiments, it can also be a data table directly obtained from the second live broadcast platform server.

[0104] In one embodiment, before the step of encoding the local original live media stream by loading the second platform real-time communication tool to generate a second live media stream, and sending the second live media stream to the second live platform server in step S103, the step further includes:

[0105] Receive a stream pulling request from the second live broadcast platform server, wherein the stream pulling request includes a communication identifier of the second live broadcast platform server;

[0106] According to the second microphone whitelist set by the first live broadcast platform server and the communication identifier of the second live broadcast platform server, the stream pulling request of the second live broadcast platform server is authenticated and determined. If it is judged to be legal, the local original live media stream is encoded by loading the second platform real-time communication tool to generate a second live media stream, and the second live media stream is sent to the second live broadcast platform server; otherwise, the stream pulling request of the second live broadcast platform server is not responded.

[0107] In this embodiment, after the first anchor client joins the first live broadcast room, it starts the live broadcast and pushes the stream to the first live broadcast platform server. In addition, the first anchor client does not push the stream directly to the second live broadcast platform server, but needs to receive the pull stream request sent by the second live broadcast platform server and authenticate the pull stream request before pushing the stream to the second live broadcast platform server. Specifically, the first anchor client determines whether the communication identifier of the second live broadcast platform server, such as the IP address or other preset identifier, is in the second white list of the second white list of the second live broadcast. If so, it is judged to be legal and push the stream, otherwise it is illegal and does not push the stream. Among them, the step of judging whether the communication identifier of the second live broadcast platform server is legal can be performed locally on the first anchor client, or the first anchor client can send the communication identifier to the first live broadcast platform server for judgment and return the judgment result. This embodiment can prevent the live media stream of the anchor from being pulled by an illegal server through the authentication of the second white list of the second white list of the second live broadcast. Similarly, the first live broadcast whitelist is a data table established and maintained in the first live broadcast platform server. In other embodiments, it can also be a data table directly obtained from the second live broadcast platform server.

[0108] In one embodiment, the first anchor client receives the first microphone connection end instruction sent by the first live broadcast platform server, stops encoding the local original live broadcast media stream, and stops sending the first live broadcast media stream and the second live broadcast media stream.

[0109] In this embodiment, when the live broadcast ends, the first live broadcast platform server sends a live broadcast end instruction to the first anchor client, thereby causing the first anchor client to stop the live broadcast. Similarly, in the second live broadcast platform, the second live broadcast platform server sends a live broadcast end instruction to the second anchor client, thereby stopping the live broadcast of the second anchor client.

[0110] For step S105, the first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and receives the third live broadcast media stream as the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with the microphone to the client that has joined the first live broadcast room with the microphone.

[0111] Specifically, when the first live broadcast platform server receives the first live broadcast media stream, it can determine that the first live broadcast media stream corresponds to the first anchor account by detecting the relevant information carried therein, and then use the first live broadcast media stream as the live broadcast media stream of the first anchor account. Similarly, the relevant information carried in the third live broadcast media stream can be detected to determine that it corresponds to the first virtual anchor account, and then use the third live broadcast media stream as the live broadcast media stream of the first virtual anchor account.

[0112] In this step, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a live media stream with microphones connected, so that the live video with microphones connected can be played in the client according to the live media stream with microphones connected.

[0113] Among them, the live broadcast media stream with microphones can be two independent live broadcast media streams without mixing; or it can be a mixed live broadcast media stream generated by mixing. Specifically, this step can complete the mixing in the first live broadcast platform server and then send the mixed live broadcast media stream with microphones to the client for playback, or the first live broadcast platform server can directly send the live media stream of the first anchor account and the live media stream of the first virtual anchor account directly to the client, so that the client can perform mixed stream playback.

[0114] In one embodiment, the step of generating a first live broadcast media stream with microphones from the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account in step S105, and sending the first live broadcast media stream with microphones to a client that has joined the first live broadcast room with microphones includes:

[0115] Mixing the live media stream of the first anchor account and the live media stream of the first virtual anchor account to obtain the first live media stream with microphones, and sending the first live media stream with microphones to the viewer client that has joined the first live broadcast room with microphones;

[0116] And / or, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are directly sent as the first live media stream of the connected microphone to the audience client that has joined the first live broadcast room with connected microphones, so that the audience client of the first live broadcast room with connected microphones mixes the live media stream of the first anchor account and the live media stream of the first virtual anchor account.

[0117] In this embodiment, the first live broadcast platform server may first mix the live media stream of the first anchor account and the live media stream of the first virtual anchor account, and then send the mixed live media stream to the viewer client that has joined the connected anchor room through the RTC network or CDN server, so that the viewer client can play it directly; or it may directly send the live media stream of the first anchor account and the live media stream of the first virtual anchor account to the viewer client through the RTC network or CDN server, and the viewer client will mix the streams and play them.

[0118] In another embodiment, the first anchor client is enabled to play the live broadcast through the following steps:

[0119] The first live broadcast platform server sends the live broadcast media stream of the first virtual anchor account to the first anchor client, so that the first anchor client receives the live broadcast media stream of the first virtual anchor account and mixes the live broadcast media stream of the first virtual anchor account with the local live broadcast media stream.

[0120] In the embodiment of this city, the local live broadcast playback method of the first anchor client is different from that of the audience client. It only needs to pull the live media stream of other anchors connected to the microphone, and then mix it with the local live media stream for playback, without having to pull the live media stream that has been mixed from the first live broadcast platform server.

[0121] In an embodiment of the present application, the client needs to use a real-time communication tool to pull the host's RTC live media stream from the live broadcast platform server with low latency, and decode the pulled RTC live media stream through the real-time communication tool.

[0122] In the above embodiment, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are encoded live media streams of the original live media streams, and therefore need to be decoded first when mixing the streams.

[0123] Furthermore, considering that the environments of different anchor clients may be different, the live media streams collected by them may also have some differences, such as differences in original data formats, resolutions, and screen ratios. Therefore, in one embodiment, the step of generating the first live media stream with microphones connected by the live media stream of the first anchor account and the live media stream of the first virtual anchor account in step S105 includes:

[0124] Converting the live media stream of the first anchor account and the live media stream of the first virtual anchor account into live media streams in a format preset by the first platform respectively;

[0125] The live media stream of the first anchor account and the live media stream of the first virtual anchor account converted into a first platform preset format are used to generate a first live media stream with microphones connected.

[0126] In this embodiment, the first live broadcast platform server first converts the live media stream of the first anchor account and the live media stream of the first virtual anchor account into live media streams of the first platform preset format according to the format specification or other requirements of the first live broadcast platform, and then generates the first live broadcast media stream with microphones from the live media stream of the first anchor account and the live media stream of the first virtual anchor account converted into the first platform preset format. Specifically, it is necessary to perform decoding first and then format conversion. The converted data can be re-encoded into RTC live media stream so that it can be transmitted in the RTC network, or the converted data can be directly used for mixed stream generation of live broadcast media stream with microphones and sent to the audience client, which can be set according to needs.

[0127] Please refer to Figure 5 The embodiment of the present application also discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first anchor client and includes the following steps:

[0128] S201: encoding a local original live media stream by loading a first platform real-time communication tool to generate a first live media stream, and sending the first live media stream to a first live platform server;

[0129] S202: encoding the local original live media stream by loading the second platform real-time communication tool to generate a second live media stream, and sending the second live media stream to the second live platform server;

[0130] The first live broadcast media stream is used to generate a first live broadcast media stream with a live broadcast media stream of a first virtual anchor account of the first live broadcast platform server, the first live broadcast media stream is used to be displayed in a first live broadcast room created by the first live broadcast platform server, and the first virtual anchor account is bound to a second anchor account of a second live broadcast platform;

[0131] The second live broadcast media stream is used to generate a live broadcast media stream of the second virtual anchor account of the second live broadcast platform server. The live broadcast media stream of the second virtual anchor account and the live broadcast media stream of the second anchor client of the second live broadcast platform server generate a second live broadcast media stream with microphones connected. The second live broadcast media stream with microphones connected is used to be displayed in the second live broadcast room with microphones connected created by the second live broadcast platform server.

[0132] The method for live broadcasting with microphones connected across live broadcast platforms described in this embodiment is protected from the execution perspective of the first anchor client, and its specific implementation refers to the steps disclosed in any of the above embodiments.

[0133] See also Figure 6 The embodiment of the present application also discloses a method for live broadcasting with microphones connected across live broadcast platforms, which is applied to a first live broadcast platform server and includes the following steps:

[0134] S301: creating a first live broadcast room with microphones connected, and adding a first live broadcast account with microphones connected to a first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client;

[0135] S302: receiving a first live media stream sent by the first anchor client as a live media stream of the first anchor account, and receiving a third live media stream sent by the second anchor client as a live media stream of the first virtual anchor account; wherein the first live media stream is generated by encoding a local original live media stream by the first anchor client by loading a first platform real-time communication tool; and the third live media stream is generated by encoding a local original live media stream by the second anchor client by loading a first platform real-time communication tool;

[0136] S303: Generate a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and send the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room.

[0137] The method for live broadcasting with microphones connected across live broadcast platforms described in this embodiment is protected from the execution perspective of the first live broadcast platform server. Its specific implementation refers to the steps disclosed in any of the above embodiments.

[0138] Please refer to Figure 7The embodiment of the present application further discloses a computer device 301, including a memory 302, a processor 303, and a computer program 304 stored in the memory 302; when the processor 303 executes the computer program 304, the steps of the method described in any of the above embodiments are implemented.

[0139] Among them, the processor 303 may include one or more processing cores. The processor 303 uses various interfaces and lines to connect various parts in the computer device 301, and executes various functions and processes data of the computer device 301 by running or executing instructions, programs, code sets or instruction sets stored in the memory 302, and calling the data in the memory 302. Optionally, the processor 303 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programble Logic Array, PLA). The processor 303 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the touch display; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 303, and it can be implemented separately through a chip.

[0140] Among them, the memory 302 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 302 includes a non-transitory computer-readable storage medium. The memory 302 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 302 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 302 may also be optionally at least one storage device located away from the aforementioned processor 303.

[0141] The present application embodiment also discloses a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to perform the method described in any of the above embodiments. That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions to make a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) perform all or part of the steps of the method described in each embodiment of the present application. The computer program may include a computer program code, which may be in the form of source code, object code, executable file or some intermediate form, etc. The aforementioned storage medium includes: any entity or device capable of carrying a computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0142] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present application, and the present application is also intended to include such modifications and modifications.

Claims

1. A method for live broadcasting with microphones across live broadcast platforms, characterized in that: The following steps are involved: The first live broadcast platform server creates a first live broadcast room with microphones connected, and adds a first live broadcast account of the first live broadcast platform to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; The first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of a second live broadcast platform, and the second anchor account corresponds to a second anchor client; The second live broadcast platform server creates a second live broadcast room with microphones connected, and adds a second live broadcast account with microphones connected to the second live broadcast room with microphones connected, wherein the second live broadcast account with microphones connected includes a second anchor account and a second virtual anchor account of the second live broadcast platform; the second virtual anchor account is bound to the first anchor account of the first live broadcast platform; The first anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a first live media stream, and sends the first live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a second live media stream, and sends the second live media stream to the second live platform server; The second anchor client loads the first platform real-time communication tool, encodes the local original live media stream through the first platform real-time communication tool to generate a third live media stream, and sends the third live media stream to the first live platform server, loads the second platform real-time communication tool, encodes the local original live media stream through the second platform real-time communication tool to generate a fourth live media stream, and sends the fourth live media stream to the second live platform server; The first live broadcast platform server receives the first live broadcast media stream as the live broadcast media stream of the first anchor account, and receives the third live broadcast media stream as the live broadcast media stream of the first virtual anchor account, generates a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sends the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room; The second live broadcast platform server receives the fourth live broadcast media stream as the live broadcast media stream of the second anchor account, and receives the second live broadcast media stream as the live broadcast media stream of the second virtual anchor account, generates a second live broadcast media stream with the live broadcast media stream of the second anchor account and the live broadcast media stream of the second virtual anchor account, and sends the second live broadcast media stream to the client that has joined the second live broadcast room.

2. A method for live broadcasting with microphones across live broadcast platforms, characterized in that: Applied to the first anchor client, including the following steps: Encode the local original live media stream by loading the first platform real-time communication tool to generate a first live media stream, and send the first live media stream to the first live platform server; Encode the local original live media stream by loading the second platform real-time communication tool to generate a second live media stream, and send the second live media stream to the second live platform server; The first live broadcast media stream is used to generate a first live broadcast media stream with a live broadcast media stream of a first virtual anchor account of the first live broadcast platform server, the first live broadcast media stream is used to be displayed in a first live broadcast room created by the first live broadcast platform server, and the first virtual anchor account is bound to a second anchor account of a second live broadcast platform; The second live broadcast media stream is used to generate a live broadcast media stream of the second virtual anchor account of the second live broadcast platform server. The live broadcast media stream of the second virtual anchor account and the live broadcast media stream of the second anchor client of the second live broadcast platform server generate a second live broadcast media stream with microphones connected. The second live broadcast media stream with microphones connected is used to be displayed in the second live broadcast room with microphones connected created by the second live broadcast platform server.

3. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: Before the step of encoding the local original live media stream by loading the first platform real-time communication tool to generate the first live media stream, and sending the first live media stream to the first live platform server, the step further includes: Receiving a first microphone connection instruction sent by the first live broadcast platform server, wherein the first microphone connection instruction includes a first microphone connection live broadcast room identifier; Join the first live broadcast room with microphones connected according to the identifier of the first live broadcast room with microphones connected.

4. The method for live broadcasting across live broadcast platforms according to claim 3, characterized in that: The step of joining the live broadcast room according to the first live broadcast room identifier includes: Parsing the first microphone connection instruction, and determining whether the current time reaches the preset microphone connection start time or is within the microphone connection start time period, if yes, entering the first microphone connection live broadcast room, otherwise not entering the first microphone connection live broadcast room; wherein the first microphone connection instruction also includes the preset microphone connection start time or the microphone connection start time period; Or, parse the first microphone connection instruction, obtain the first microphone connection live broadcast room identifier, and directly join the first microphone connection live broadcast room.

5. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: Before the step of encoding the local original live media stream by loading the second platform real-time communication tool to generate a second live media stream, and sending the second live media stream to the second live platform server, the step further includes: Receive a stream pulling request from the second live broadcast platform server, wherein the stream pulling request includes a communication identifier of the second live broadcast platform server; According to the microphone whitelist set by the first live broadcast platform server and the communication identifier of the second live broadcast platform server, the stream pulling request of the second live broadcast platform server is authenticated and determined. If it is judged to be legal, the local original live media stream is encoded by loading the second platform real-time communication tool to generate a second live media stream, and the second live media stream is sent to the second live broadcast platform server; otherwise, the stream pulling request of the second live broadcast platform server is not responded.

6. The method for live broadcasting across live broadcast platforms according to claim 2, characterized in that: Also includes the steps: Receive a first microphone connection end instruction sent by the first live broadcast platform server, stop encoding the local original live broadcast media stream, and stop sending the first live broadcast media stream and the second live broadcast media stream.

7. A method for live broadcasting with microphones across live broadcast platforms, characterized in that: Applied to the first live broadcast platform server, including the following steps: A first live broadcast room with microphones connected is created, and a first live broadcast account with microphones connected to the first live broadcast room with microphones connected is added to the first live broadcast room with microphones connected, wherein the first live broadcast account with microphones connected includes a first anchor account and a first virtual anchor account of the first live broadcast platform; the first anchor account corresponds to a first anchor client, the first virtual anchor account is bound to a second anchor account of the second live broadcast platform, and the second anchor account corresponds to a second anchor client; The first live media stream received from the first anchor client is the live media stream of the first anchor account, and the third live media stream received from the second anchor client is the live media stream of the first virtual anchor account; wherein the first live media stream is generated by encoding the local original live media stream by the first anchor client by loading the first platform real-time communication tool; and the third live media stream is generated by encoding the local original live media stream by the second anchor client by loading the first platform real-time communication tool; The live media stream of the first anchor account and the live media stream of the first virtual anchor account are used to generate a first live media stream with microphones connected, and the first live media stream with microphones connected is sent to a client that has joined the first live broadcast room with microphones connected.

8. The method for live broadcasting across live broadcast platforms according to claim 7, characterized in that: The step of generating a first live broadcast media stream with microphones connected to the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account, and sending the first live broadcast media stream with microphones connected to the client that has joined the first live broadcast room with microphones connected to the live broadcast room includes: Mixing the live media stream of the first anchor account and the live media stream of the first virtual anchor account to obtain the first live media stream with microphones, and sending the first live media stream with microphones to the viewer client that has joined the first live broadcast room with microphones; And / or, the live media stream of the first anchor account and the live media stream of the first virtual anchor account are directly sent as the first live media stream of the connected microphone to the audience client that has joined the first live broadcast room with connected microphones, so that the audience client of the first live broadcast room with connected microphones mixes the live media stream of the first anchor account and the live media stream of the first virtual anchor account.

9. The method for live broadcasting across live broadcast platforms according to claim 7, characterized in that: Also includes the steps: The live media stream of the first virtual anchor account is sent to the first anchor client, so that the first anchor client receives the live media stream of the first virtual anchor account and mixes the live media stream of the first virtual anchor account with the local live media stream.

10. The method for live broadcasting across live broadcast platforms according to claim 7, characterized in that: The step of generating a first live broadcast media stream with microphones connected by using the live broadcast media stream of the first anchor account and the live broadcast media stream of the first virtual anchor account comprises: Converting the live media stream of the first anchor account and the live media stream of the first virtual anchor account into live media streams in a format preset by the first platform respectively; The live media stream of the first anchor account and the live media stream of the first virtual anchor account converted into a first platform preset format are used to generate a first live media stream with microphones connected.

11. A computer device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory, wherein the computer program implements the steps of the method according to any one of claims 1 to 10 when executed by the processor.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 10.

Images