Live broadcast microphone connection method and device, and storage medium

Abstract

The embodiment of the invention provides a live broadcast microphone connection method and device and a storage medium, and the method comprises the steps: obtaining a first real-time multimedia stream of at least one live broadcast participant client in a first multi-user microphone connection live broadcast room through any live broadcast participant client in the first multi-user microphone connection live broadcast room, and playing the first real-time multimedia stream; on the basis of the cross-room microphone connection instruction, public stream data of a second multi-user microphone connection live broadcast room is acquired, and the public stream data is formed by converging second real-time multimedia streams of a plurality of live broadcast participant clients in the second multi-user microphone connection live broadcast room; and playing the public stream data. During cross-room microphone connection, only one path of public stream data needs to be acquired for an opposite multi-person microphone connection live broadcast room, so that the pressure on the performance of a live broadcast client is reduced, the bandwidth and traffic cost is reduced, and the live broadcast microphone connection experience is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer and network communication technology, and more particularly to a live broadcast and microphone connection method, device, and storage medium. Background Art

[0002] During live streaming, live broadcasting is a method often used by anchors to interact with other anchors. Based on this method, the anchor in the current live broadcast room can invite other anchors to broadcast live together.

[0003] In the prior art, when live broadcasting with microphones connected, each live broadcast participant client needs to obtain the audio and video streams of all other live broadcast participant clients from the server. If there are many live broadcast participants, it will cause performance pressure on the client, high bandwidth and traffic costs, and easy to cause problems, seriously affecting the experience. Summary of the invention

[0004] The embodiments of the present disclosure provide a live broadcast and microphone connection method, device, and storage medium to reduce the pressure on the performance of a live broadcast client when connecting microphones across rooms, reduce bandwidth and traffic costs, and improve the live broadcast and microphone connection experience.

[0005] In a first aspect, an embodiment of the present disclosure provides a live broadcast and microphone connection method, which is applied to any live broadcast participant client in a first multi-person microphone connection live broadcast room, and the method includes:

[0006] Acquire a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room, and play the stream;

[0007] Based on the cross-room live broadcast instruction, obtain public stream data of the second multi-person live broadcast room, wherein the public stream data is formed by merging second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room;

[0008] The common stream data is played.

[0009] In a second aspect, an embodiment of the present disclosure provides a live broadcast and microphone connection method, which is applied to a server, and the method includes:

[0010] Pushing a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0011] Based on the cross-room live broadcast instruction, the first public stream data corresponding to the first multi-person live broadcast room is pushed to the live broadcast participant client in the second multi-person live broadcast room, and the second public stream data corresponding to the second multi-person live broadcast room is pushed to the live broadcast participant client in the first multi-person live broadcast room.

[0012] In a third aspect, the present disclosure provides a live broadcast participant client, including:

[0013] The stream pulling unit in this room is used to obtain a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and play it;

[0014] A public stream pulling unit, configured to obtain public stream data of a second multi-person live broadcast room based on a cross-room live broadcast instruction, wherein the public stream data is a confluence of second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room;

[0015] A control unit, used to control the playing of the public stream data

[0016] In a fourth aspect, an embodiment of the present disclosure provides a server, including:

[0017] The same-room streaming unit is used to push a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0018] The public stream pushing unit is used to push the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room based on the cross-room live broadcast instruction, and push the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room.

[0019] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;

[0020] The memory stores computer-executable instructions;

[0021] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect.

[0022] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect is implemented.

[0023] In the seventh aspect, an embodiment of the present disclosure provides a computer program product, including computer execution instructions. When a processor executes the computer execution instructions, it implements the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect.

[0024] The live broadcast and microphone connection method, device and storage medium provided by the embodiments of the present disclosure obtain the first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room through any live broadcast participant client in the first multi-person live broadcast room, and play it; based on the cross-room microphone connection instruction, obtain the public stream data of the second multi-person live broadcast room, wherein the public stream data is the confluence of the second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room; and play the public stream data. When connecting to the microphone across rooms, only one channel of public stream data needs to be obtained for the other multi-person live broadcast room, avoiding pulling the real-time multimedia stream of each live broadcast participant client in the other multi-person live broadcast room, and reducing the number of running decoders, alleviating the pressure on the performance of the live broadcast client, reducing the bandwidth and traffic costs, and the cross-room microphone connection termination process is simple, and crosstalk is not easy to occur, thereby improving the live broadcast and microphone connection experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0026] Figure 1a This is an example diagram of an interface of a method for live broadcasting and microphone connection across rooms in the prior art;

[0027] Figure 1b A system schematic diagram of a method for cross-room live broadcast and microphone connection in the prior art;

[0028] Figure 2 A system diagram of a live broadcast and microphone connection method provided by an embodiment of the present disclosure;

[0029] Figure 3A schematic diagram of a live broadcast and microphone connection method flow chart provided in an embodiment of the present disclosure;

[0030] Figure 4 A schematic diagram of a live broadcast and microphone connection method flow chart provided in another embodiment of the present disclosure;

[0031] Figure 5 A schematic diagram of a server architecture provided in accordance with an embodiment of the present disclosure;

[0032] Figure 6 A structural block diagram of a live broadcast participant client provided in an embodiment of the present disclosure;

[0033] Figure 7 A structural block diagram of a server provided in an embodiment of the present disclosure;

[0034] Figure 8 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0036] In the process of live broadcasting, a live broadcaster often uses a method of interactive live broadcasting with other live broadcasters. Based on this method, the live broadcaster in the current live broadcast room can invite other live broadcasters to live broadcast together. In the prior art, when live broadcasting with a live broadcaster, each live broadcast participant client needs to pull the audio and video streams of all other live broadcast participant clients in the live broadcast room from the server.

[0037] In a cross-room live broadcast scenario, multiple hosts are connected to the microphone in one live broadcast room, and multiple hosts are also connected to the microphone in another live broadcast room. The two live broadcast rooms can be connected to the microphone in a cross-room manner (for example, a battle between the live broadcast rooms), so that all hosts in the cross-room connected live broadcast rooms can communicate with each other, and the host client of each live broadcast room can simultaneously watch the screens of all hosts in the two live broadcast rooms. Figure 1a shown.

[0038] If the live broadcast method with microphone connection in the prior art is used, when the live broadcast is connected to microphones across rooms, each live broadcast participant client needs to push its audio and video stream to the opposite live broadcast room in addition to pulling the audio and video streams of all live broadcast participant clients in the live broadcast room, and also needs to pull the audio and video streams of all live broadcast participant clients in the opposite live broadcast room. The process is as follows: Figure 1b As shown, based on the server, in addition to pushing audio and video streams to live broadcast room 1, each live broadcast participant client in live broadcast room 1 also needs to push audio and video streams to live broadcast room 2. Similarly, in addition to pushing audio and video streams to live broadcast room 2, each live broadcast participant client in live broadcast room 2 also needs to push audio and video streams to live broadcast room 2. In this way, in addition to pulling the audio and video streams of other live broadcast participant clients in this live broadcast room from live broadcast room 1, each live broadcast participant client in live broadcast room 1 also needs to pull the audio and video streams pushed to live broadcast room 1 by each live broadcast participant client in live broadcast room 2. In addition to pulling the audio and video streams of other live broadcast participant clients in this live broadcast room from live broadcast room 2, each live broadcast participant client in live broadcast room 2 also needs to pull the audio and video streams pushed to live broadcast room 2 by each live broadcast participant client in live broadcast room 1.

[0039] If there are many participants in the cross-room live broadcast, more audio and video streams need to be pulled, and each audio and video stream needs to be decoded by running a decoder, which puts performance pressure on the client. For example, if 11 audio and video streams need to be pulled, 11 decoders need to be run. Since there are many audio and video streams to be pulled, and each audio and video stream is a low-latency RTC (Real-Time Communications) audio and video stream, the bandwidth and traffic costs are high. And problems are prone to occur. For example, at the end of the cross-room live broadcast, it is necessary to stop pulling the audio and video streams of all the live broadcast participant clients in the opposite live broadcast room. However, if the audio and video streams of any live broadcast participant client in the opposite live broadcast room do not stop pushing the stream to this live broadcast room, the audio and video streams of each live broadcast participant client in this live broadcast room can still be pulled, resulting in crosstalk problems, which seriously affects the experience.

[0040] In order to solve the above technical problems, the present invention provides a live broadcast connection method. In order to reduce the number of real-time multimedia streams, it is possible to consider merging multiple real-time multimedia streams, that is, adopting the MCU (Multipoint Conferencing Unit) architecture in the WebRTC technology. However, due to the delay of the MCU architecture, if all real-time multimedia streams are merged, the real-time performance of the live broadcast connection will be affected. Considering that in some scenarios such as battles between rooms when connecting to the microphone across rooms, real-time calls are required between the live broadcast participants in the same multi-person live broadcast room, while real-time calls are not required between the live broadcast participants in different multi-person live broadcast rooms (it is possible that one multi-person live broadcast room will mute another multi-person live broadcast room), the real-time requirement is not high. Therefore, the MCU architecture and SFU (Selective Forwarding Unit) in the WebRTC technology can be combined. Unit, selective forwarding unit) architecture (existing technology), that is, only the real-time multimedia stream of each live broadcast participant client in the other party's multi-person live broadcast room is merged into one public stream data, while the real-time multimedia stream of each live broadcast participant client in this room is still pulled separately in real time, so that only the public stream data of the other party's multi-person live broadcast room needs to be pulled, and there is no need to pull the real-time multimedia streams of each live broadcast participant client in the other party's multi-person live broadcast room separately, and the number of running decoders is reduced, the pressure on the performance of the live broadcast client is alleviated, the bandwidth and traffic costs are reduced, and the cross-room live broadcast ending process is simple, crosstalk is not easy to occur, and the live broadcast experience is improved.

[0041] Specifically, the live broadcast method may include obtaining, through any live broadcast participant client in the first multi-person live broadcast room, a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room, and playing the stream; obtaining, based on a cross-room live broadcast instruction, public stream data of a second multi-person live broadcast room, wherein the public stream data is a multimedia stream formed by merging second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room; playing the public stream data, at this time, Figure 2 As shown, the data pulled by any live broadcast participant client in the first multi-person live broadcast room includes the first real-time multimedia stream of at least one other live broadcast participant client in the first multi-person live broadcast room currently located, and the public stream data of the second multi-person live broadcast room, thereby realizing cross-room live broadcasting. For other live broadcast participant clients in the first multi-person live broadcast room, each live broadcast participant client in the second multi-person live broadcast room and Figure 2 Similarly, they are not shown one by one here.

[0042] It should be noted that the user information and data involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0043] The live broadcast and microphone connection method disclosed in the present invention will be described in detail below in conjunction with specific embodiments.

[0044] refer to Figure 3 , Figure 3 A flowchart of a live broadcast and microphone connection method provided in an embodiment of the present disclosure. The method of this embodiment can be applied in a live broadcast participant client, and the live broadcast and microphone connection method includes:

[0045] S201: Obtain a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room, and play the stream.

[0046] In this embodiment, the live broadcast participant client of the first multi-person live broadcast room is the client participating in the live broadcast room, and the multiple live broadcast participant (including anchor and guest) clients in the first multi-person live broadcast room are connected to each other, that is, each live broadcast participant client in the first multi-person live broadcast room can obtain the real-time multimedia stream (referred to as the first real-time multimedia stream) of other live broadcast participant clients in the first multi-person live broadcast room except for the live broadcast participant client and play it in the client interface, so that each live broadcast participant in the first multi-person live broadcast room can not only see his own picture in his client interface, but also play the pictures and sounds of other live broadcast participants in the first multi-person live broadcast room at the same time. Of course, any live broadcast participant client in the first multi-person live broadcast room can also turn off the collection of video and audio, that is, the live broadcast participant client does not collect its own first real-time multimedia stream, nor does it send its own first real-time multimedia stream to the server, but can obtain the first real-time multimedia stream of other live broadcast participant clients from the server, that is, it cannot see its own picture in its client interface, but can play the pictures and sounds of other live broadcast participants in the first multi-person live broadcast room. Therefore, any live broadcast participant client in the first multi-person live broadcast room can obtain the first real-time multimedia stream of at least one other live broadcast participant client except itself from the server; if all other live broadcast participant clients turn off video and audio collection, they can only play their own first real-time multimedia stream.

[0047] Optionally, the first multi-person live broadcast room is an RTC room. RTC, also known as WebRTC (Web Real-Time Communications), is a real-time communication technology that allows network applications or sites to establish peer-to-peer connections between browsers without the help of an intermediary, to achieve the transmission of video streams and / or audio streams or any other data. Accordingly, the first real-time multimedia stream is an RTC stream. Each live broadcast participant client in the RTC room can push its own RTC stream to the RTC room in the server, and can also pull the RTC streams of other live broadcast participant clients from the RTC room in the server.

[0048] Similarly, the second multi-person live broadcast room is another multi-person live broadcast room, the live broadcast participant client of the first multi-person live broadcast room is the client participating in the live broadcast in the second multi-person live broadcast room, and the clients of multiple live broadcast participants (including anchors and guests) in the second multi-person live broadcast room are also connected to each other, that is, each live broadcast participant client in the second multi-person live broadcast room can obtain the real-time multimedia stream (recorded as the second real-time multimedia stream) of at least one other live broadcast participant client in the second multi-person live broadcast room and play it in the client interface, so that each live broadcast participant in the second multi-person live broadcast room can play the acquired picture and sound of at least one other live broadcast participant in the second multi-person live broadcast room on his client, and can also see his own picture (if the video and audio collection is turned off, he cannot see his own picture).

[0049] S202: Acquire public stream data of the second multi-person live broadcast room, wherein the public stream data is formed by merging second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

[0050] In this embodiment, when a cross-room live broadcast room with multiple people needs to be connected to the microphone and the second cross-room live broadcast room with multiple people needs to be connected to the microphone, any live broadcast participant client in any cross-room live broadcast room with multiple people needs to initiate a cross-room live broadcast room with multiple people needs to be connected to the microphone to the other cross-room live broadcast room with multiple people needs to be connected to the microphone. After any live broadcast participant client in the other cross-room live broadcast room with multiple people needs to be connected to the microphone agrees to the cross-room live broadcast room with multiple people needs to be connected to the microphone, the cross-room live broadcast room with multiple people needs to be connected to the microphone and the second cross-room live broadcast room with multiple people needs to be connected to the microphone starts.

[0051] When the first multi-person live broadcast room and the second multi-person live broadcast room are connected across rooms, in scenarios such as battles between rooms, real-time calls are required between the live broadcast participants in the same multi-person live broadcast room, while real-time calls are not required between the live broadcast participants in different multi-person live broadcast rooms. It is also possible that one multi-person live broadcast room will mute another multi-person live broadcast room. Therefore, the real-time requirement is not high. In addition, in order to avoid the need to pull the real-time multimedia stream of each live broadcast participant client in the other multi-person live broadcast room for cross-room connection, and to run a decoder for each real-time multimedia stream, which causes pressure on client performance and increases bandwidth and traffic costs, in this embodiment, the real-time multimedia stream of each live broadcast participant client in the other multi-person live broadcast room is merged into one public stream data. In this way, only the public stream data of the other multi-person live broadcast room needs to be pulled, and there is no need to pull the real-time multimedia streams of multiple live broadcast participant clients in the other multi-person live broadcast room separately.

[0052] Among them, in RTC technology, RTC room supports users to directly pull multimedia streams in the RTC room without entering the room, which can be called public streams. The public stream is the confluence of the multimedia streams in the RTC room. Therefore, in this embodiment, the method of obtaining public streams in the RTC room can be applied to obtain the public stream data of each multi-person live broadcast room. In addition, the public stream data can still be released in the RTC stream mode to minimize the delay.

[0053] Optionally, the public stream data of the first multi-person live broadcast room and the public stream data of the second multi-person live broadcast room can be configured with identification information (ID) of the public stream data respectively. The identification information of the public stream data can be configured by the server, or can also be configured by the live broadcast participant client, and each live broadcast participant client of the first multi-person live broadcast room knows the identification information of the public stream data of the second multi-person live broadcast room, and each live broadcast participant client of the second multi-person live broadcast room knows the identification information of the public stream data of the first multi-person live broadcast room. Further, any live broadcast participant client of the first multi-person live broadcast room can obtain the public stream data of the second multi-person live broadcast room according to the identification information of the public stream data of the second multi-person live broadcast room, and any live broadcast participant client of the second multi-person live broadcast room can obtain the public stream data of the first multi-person live broadcast room according to the identification information of the public stream data of the first multi-person live broadcast room. Optionally, the public stream data can be obtained according to the identification information of the public stream data through the publish / subscribe mode.

[0054] S203: Play the public stream data.

[0055] In this embodiment, after obtaining the public stream data of the second multi-person live broadcast room, any live broadcast participant client in the first multi-person live broadcast room can play the public stream data. At this time, it is still necessary to continue to obtain the first real-time multimedia stream of other live broadcast participant clients in the first multi-person live broadcast room for playback to ensure the real-time performance of the first multi-person live broadcast room. Similarly, for any live broadcast participant client in the second multi-person live broadcast room, after obtaining the public stream data of the first multi-person live broadcast room, it can play the public stream data. It is also necessary to continue to obtain the second real-time multimedia stream of other live broadcast participant clients in the second multi-person live broadcast room for playback to ensure the real-time performance of the second multi-person live broadcast room.

[0056] For any live broadcast participant client in the second multi-person live broadcast room, the steps are similar to those for any live broadcast participant client in the first multi-person live broadcast room, and will not be repeated here.

[0057] In this embodiment, when it is necessary to end the cross-room live broadcast, any live broadcast participant client of the first multi-person live broadcast room can directly stop obtaining and playing the public stream data of the second multi-person live broadcast room, and there will be no crosstalk problem.

[0058] The live broadcast method provided in this embodiment obtains the first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room through any live broadcast participant client in the first multi-person live broadcast room, and plays it; based on the cross-room live broadcast instruction, obtains the public stream data of the second multi-person live broadcast room, wherein the public stream data is the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room; and plays the public stream data. When connecting to the live broadcast room across rooms, only one public stream data needs to be obtained for the other multi-person live broadcast room, avoiding pulling the real-time multimedia stream of each live broadcast participant client in the other multi-person live broadcast room, reducing bandwidth and traffic costs, and alleviating pressure on the performance of the live broadcast client, wherein the number of pulled streams is reduced, the number of running decoders is reduced, the CPU overhead is reduced, and at the same time, the screens that need to be rendered are reduced during GPU rendering, the drawing instructions are reduced, and the GPU overhead is reduced; and the cross-room live broadcast ending process is simple, and crosstalk is not easy to occur, thereby improving the live broadcast experience.

[0059] Based on any of the above embodiments, another embodiment of the present disclosure provides a live broadcast and microphone connection method, the live broadcast and microphone connection method comprising:

[0060] S301, obtaining a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room, and playing the stream;

[0061] This step is the same as S201.

[0062] S302: Based on the cross-room live broadcast instruction, obtain a second real-time multimedia stream of multiple live broadcast participant clients in a second multi-person live broadcast room, and play the stream.

[0063] In this embodiment, when a cross-room connection is required between the first multi-person live broadcast room and the second multi-person live broadcast room, any live broadcast participant client in any multi-person live broadcast room can initiate a cross-room connection request to the other multi-person live broadcast room. After any live broadcast participant client in the other multi-person live broadcast room agrees to the cross-room connection request, the first multi-person live broadcast room and the second multi-person live broadcast room start cross-room connection, and a cross-room connection instruction is issued to each live broadcast participant client in the two multi-person live broadcast rooms. Considering that it takes a certain amount of time for the server to perform the merging operation, each live broadcast participant client can obtain the real-time multimedia streams of multiple live broadcast participant clients in the other multi-person live broadcast room according to the cross-room connection instruction, so as to ensure a quick response to the cross-room connection instruction without waiting for the public stream data.

[0064] For example, any live broadcast participant client in the first multi-person live broadcast room obtains the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room, and plays it in the client interface, so that the live broadcast participant client can play the pictures and sounds of multiple live broadcast participants in the second multi-person live broadcast room at the same time in addition to playing its own picture and the picture and sound of at least one other live broadcast participant in the first multi-person live broadcast room (if the video and audio collection is turned off, then the user cannot see his own picture) in its client interface; any live broadcast participant client in the second multi-person live broadcast room obtains the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room, and plays it in the client interface, so that the live broadcast participant client can play the pictures and sounds of multiple live broadcast participants in the first multi-person live broadcast room at the same time in addition to playing its own picture (if the video and audio collection is turned off, then the user cannot see his own picture) and the picture and sound of at least one other live broadcast participant in the second multi-person live broadcast room.

[0065] Optionally, in response to the cross-room live broadcast instruction, multiple live broadcast participant clients in the second multi-person live broadcast room push their respective second real-time multimedia streams to the first multi-person live broadcast room on the server side, and multiple live broadcast participant clients in the first multi-person live broadcast room push their respective first real-time multimedia streams to the second multi-person live broadcast room on the server side.

[0066] Optionally, the server may also respond to the cross-room microphone connection instruction and perform cross-room streaming, that is, push the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person microphone connection live broadcast room on the server to the second multi-person microphone connection live broadcast room, and push the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person microphone connection live broadcast room on the server to the first multi-person microphone connection live broadcast room. Each live broadcast participant client can simultaneously obtain the first real-time multimedia stream and the second real-time multimedia stream from their respective multi-person microphone connection live broadcast room on the server for playback.

[0067] S303: Based on the cross-room live broadcast instruction, obtain the public stream data of the second multi-person live broadcast room.

[0068] In this embodiment, after the server merges the second real-time multimedia streams to obtain the public stream data, any live broadcast participant client in the first multi-person live broadcast room can obtain the public stream data of the second multi-person live broadcast room; similarly, after the server merges the first real-time multimedia streams to obtain the public stream data, any live broadcast participant client in the second multi-person live broadcast room can obtain the public stream data of the first multi-person live broadcast room. For details, see S202.

[0069] S304: Play the common stream data, and stop acquiring and playing the second real-time multimedia stream.

[0070] In this embodiment, after any live broadcast participant client of the first multi-person live broadcast room obtains the public stream data of the second multi-person live broadcast room, it can play the public stream data to replace the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room. That is, the acquisition (mute operation) and playback of multiple second real-time multimedia streams can be stopped, but the first real-time multimedia stream of at least one other live broadcast participant client in the first multi-person live broadcast room still needs to be acquired for playback to ensure the real-time performance of the first multi-person live broadcast room.

[0071] Similarly, for any live broadcast participant client in the second multi-person live broadcast room, after obtaining the public stream data of the first multi-person live broadcast room, the public stream data can be played to replace the second real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room. That is, the acquisition (mute operation) and playback of multiple first real-time multimedia streams can be stopped, but the second real-time multimedia stream of at least one other live broadcast participant client in the second multi-person live broadcast room must still be acquired for playback to ensure the real-time performance of the second multi-person live broadcast room.

[0072] Optionally, in order to ensure smooth switching between each second real-time multimedia stream and the public stream data without lag, any live participant client in the first multi-person live broadcast room can, after acquiring the public stream data, keep playing each second real-time multimedia stream while decoding the public stream data, and after the first frame of the public stream data is successfully decoded, switch the second real-time multimedia stream with the public stream data, that is, play the public stream data, and stop acquiring and playing the multiple second real-time multimedia streams. Of course, if the first frame decoding of the public stream data fails, the multiple second real-time multimedia streams can continue to be acquired and played.

[0073] Optionally, when any live broadcast participant client in the first multi-person live broadcast room plays the common stream data, if the playback fails, such as due to transmission interruption or decoding error, multiple second real-time multimedia streams can be obtained and played, that is, the common stream data is switched back to the multiple second real-time multimedia streams to ensure the continuation of the live broadcast. Or when the live broadcast participant clients in the first multi-person live broadcast room and the second multi-person live broadcast room need to have a real-time conversation across rooms, the common stream data can also be switched back to the multiple second real-time multimedia streams to ensure the real-time nature of the conversation across rooms.

[0074] Based on any of the above embodiments, obtaining the public stream data of the second multi-person live broadcast room in S202 may specifically include:

[0075] In response to a mute instruction for a second multi-person live broadcast room, obtaining first-category public stream data for the second multi-person live broadcast room from a server, wherein the first-category public stream data is formed by combining real-time video streams of multiple live broadcast participant clients in the second multi-person live broadcast room with the server; or

[0076] In response to an unmute instruction to a second multi-person live broadcast room, second-category public stream data of the second multi-person live broadcast room is obtained from a server, wherein the second-category public stream data is formed by the server merging the real-time audio and video streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

[0077] In this embodiment, any live broadcast participant client (for example, the anchor client) of the first multi-person live broadcast room can control the mute of the second multi-person live broadcast room, that is, each live broadcast participant client of the first multi-person live broadcast room cannot hear the sound of each live broadcast participant client of the second multi-person live broadcast room, but can see the picture. By triggering the mute command of the second multi-person live broadcast room, the server only merges the real-time video stream of the second multi-person live broadcast room when obtaining the public stream data of the second multi-person live broadcast room, and the first type of public stream data of the second multi-person live broadcast room is obtained by merging. When any live broadcast participant client of the first multi-person live broadcast room obtains and plays the first type of public stream data of the second multi-person live broadcast room, the second multi-person live broadcast room is muted.

[0078] Similarly, any live broadcast participant client (such as the anchor client) of the first multi-person live broadcast room can control the second multi-person live broadcast room to unmute, that is, each live broadcast participant client in the first multi-person live broadcast room can hear the voice and see the picture of each live broadcast participant client in the second multi-person live broadcast room. By triggering the unmute command for the second multi-person live broadcast room, the server can merge the real-time audio and video streams of the second multi-person live broadcast room when obtaining the public stream data of the second multi-person live broadcast room, and obtain the second type of public stream data of the second multi-person live broadcast room. When any live broadcast participant client of the first multi-person live broadcast room obtains and plays the second type of public stream data of the second multi-person live broadcast room, the second multi-person live broadcast room can be unmuted.

[0079] The process of any live broadcast participant client (such as the host client) of the second multi-person live broadcast room controlling the muting and unmuting of the second multi-person live broadcast room is similar to the above process and will not be repeated here.

[0080] On the basis of any of the above embodiments, when the server merges the real-time video streams of each live broadcast participant client in the second multi-person live broadcast room, it can obtain the audio and video status information and / or volume information of the real-time multimedia streams of each live broadcast participant client in the second multi-person live broadcast room, where the audio and video status information may include whether there is sound, whether the sound is background music, or whether it is a human voice, and the volume information may be human voice volume information and / or background music volume information. Further, the server can carry the audio and video status information and / or volume information in the public stream data, so that when any live broadcast participant client in the first multi-person live broadcast room decodes the public stream data of the second multi-person live broadcast room, the audio and video status information and / or volume information of the real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room can be obtained. When playing the public stream data, the corresponding audio and video status information and / or volume information can be displayed in the display area corresponding to each live broadcast participant in the public stream data, so that it can be determined which live broadcast participant client in the second multi-person live broadcast room is speaking.

[0081] When any live broadcast participant client in the first multi-person live broadcast room obtains the first real-time multimedia stream of at least one other live broadcast participant client in the current first multi-person live broadcast room, each first real-time multimedia stream carries its own audio and video status information and / or volume information. When any live broadcast participant client in the first multi-person live broadcast room plays any first real-time multimedia stream, the corresponding audio and video status information and / or volume information can be displayed in the display area corresponding to the first real-time multimedia stream, so as to determine which live broadcast participant client in the first multi-person live broadcast room is speaking.

[0082] Based on any of the above embodiments, during the cross-room live broadcasting process, the audience client can simultaneously watch the live broadcasting process of each live broadcast participant in each multi-person live broadcasting room.

[0083] Optionally, any live broadcast participant client in the first multi-person live broadcast room can merge the first real-time multimedia streams and public stream data of each live broadcast participant client in the first multi-person live broadcast room, upload the merged multimedia stream to the server, and push it to the audience client for playback by the server, so that the audience client can watch the cross-room live broadcast process.

[0084] Optionally, considering that the confluence performed by the live broadcast participant clients increases the pressure on the live broadcast client performance, the confluence can also be performed by the server. The server can merge the public stream data of the first multi-person live broadcast room with the public stream data of the second multi-person live broadcast room, and push the merged multimedia stream by the server to the audience client for playback, so that the audience client can watch the cross-room live broadcast process.

[0085] refer to Figure 4 , Figure 4 A flowchart of a live broadcast and microphone connection method provided in an embodiment of the present disclosure. The method of this embodiment can be applied in a server, and the live broadcast and microphone connection method includes:

[0086] S401, pushing a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in a second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0087] S402: Based on the cross-room live broadcast instruction, the first public stream data corresponding to the first multi-person live broadcast room is pushed to the live broadcast participant clients in the second multi-person live broadcast room, and the second public stream data corresponding to the second multi-person live broadcast room is pushed to the live broadcast participant clients in the first multi-person live broadcast room.

[0088] Specifically, after receiving the cross-room live broadcast instruction, the real-time multimedia streams in the same multi-person live broadcast room are merged respectively to obtain the public stream data corresponding to the first multi-person live broadcast room and the public stream data corresponding to the second multi-person live broadcast room, and then the first public stream data and the second public stream data are pushed to the live broadcast participant clients of the other multi-person live broadcast room for playback.

[0089] The live broadcast and microphone connection method in this embodiment is the live broadcast and microphone connection method on the server side in the above S201-S203 corresponding embodiments. Its implementation principle and technical effects can be found in the above embodiments and will not be repeated here.

[0090] It should be noted that this embodiment can be executed on the same server or in a server cluster. For example, the task of transmitting the real-time multimedia stream can be executed on one or more servers, while the task of merging the real-time multimedia streams to obtain common stream data can be executed on another one or more servers. The servers that perform the two tasks are controlled in one server cluster (for example, in a computer room in the same area) as much as possible to reduce the time spent on the detour of the real-time multimedia stream. An optional server-side architecture can be as follows: Figure 5As shown, each live broadcast participant client in the second multi-person live broadcast room pushes the second real-time multimedia stream to server A, and the live broadcast connection between each live broadcast participant client in the second multi-person live broadcast room can be realized through server A; similarly, the live broadcast connection between each live broadcast participant client in the first multi-person live broadcast room can be realized through server C; when connecting across rooms, server A sends the second real-time multimedia stream of each live broadcast participant client in the second multi-person live broadcast room to server B, server B performs a merging operation to obtain the public stream data of the second multi-person live broadcast room, and then pushes the public stream data of the second multi-person live broadcast room to server C, and server C pushes the public stream data of the second multi-person live broadcast room to each live broadcast participant client in the first multi-person live broadcast room.

[0091] Based on the above embodiment, another embodiment of the present disclosure provides a live broadcast and microphone connection method, the live broadcast and microphone connection method comprising:

[0092] S501, pushing a first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of each live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0093] S502: In response to the cross-room live broadcast instruction, push a first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room and a second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room to the live broadcast participant clients in the other multi-person live broadcast room;

[0094] S503: merge multiple real-time multimedia streams in the same multi-person live broadcast room to obtain public stream data corresponding to the first multi-person live broadcast room and public stream data corresponding to the second multi-person live broadcast room;

[0095] S504: Push the first public stream data and the second public stream data to the clients of each live broadcast participant in the other party's multi-person live broadcast room for playback.

[0096] The live broadcast and microphone connection method in this embodiment is the live broadcast and microphone connection method on the server side in the above S301-S304 corresponding embodiments. Its implementation principle and technical effects can be found in the above embodiments and will not be repeated here.

[0097] On the basis of the above embodiment, the step of combining the first real-time multimedia streams to obtain first common stream data and combining the second real-time multimedia streams to obtain second common stream data includes:

[0098] In response to a mute instruction for any multi-person live broadcast room, real-time video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain first-category public stream data of the multi-person live broadcast room; or

[0099] In response to an unmute instruction for any multi-person live broadcast room, real-time audio and video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain second-category public stream data of the multi-person live broadcast room.

[0100] Based on any of the above embodiments, the live broadcast and microphone connection method further includes:

[0101] When the public stream data of any multi-person live broadcast room is obtained by merging, the audio and video status information and / or volume information of the real-time multimedia streams of multiple live broadcast participant clients in the multi-person live broadcast room is obtained and carried in the public stream data.

[0102] Based on any of the above embodiments, the live broadcast and microphone connection method further includes:

[0103] Merging the first public stream data and the second public stream data to obtain a merged multimedia stream, and pushing the merged multimedia stream to a viewer client for playback; or

[0104] Receive the merged multimedia stream uploaded by any live broadcast participant client, and push the merged multimedia stream to the audience client for playback, wherein the uploaded merged multimedia stream is a multimedia stream merged by the real-time multimedia streams of each live broadcast participant client in the multi-person live broadcast room where the live broadcast participant client is located and the public stream data of the other party's multi-person live broadcast room.

[0105] Corresponding to the live broadcast and microphone connection method on the live broadcast participant client side of the above embodiment, Figure 6 This is a structural block diagram of a live broadcast participant client provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 6 The live broadcast participant client 600 includes: a room stream pulling unit 601, a public stream pulling unit 602, and a control unit 603.

[0106] The current room stream pulling unit 601 is used to obtain and play a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room;

[0107] The public stream pulling unit 602 is used to obtain public stream data of a second multi-person live broadcast room based on a cross-room live broadcast instruction, wherein the public stream data is a confluence of second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room;

[0108] The control unit 603 is used to control the playing of the common stream data.

[0109] In one or more embodiments of the present disclosure, when acquiring the first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room, the local room stream pulling unit 601 is used to:

[0110] A first real-time multimedia stream of at least one other live broadcast participant client except any one of the live broadcast participant clients in the first multi-person live broadcast room is obtained from the server.

[0111] In one or more embodiments of the present disclosure, the live broadcast participant client 600 further includes a cross-room streaming unit 604, which is used to:

[0112] Before obtaining the public stream data of the second multi-person live broadcast room, based on the cross-room live broadcast instruction, respectively obtain each of the second real-time multimedia streams and play them;

[0113] The control unit 603 is further configured to stop acquiring and playing the second real-time multimedia stream after playing the common stream data.

[0114] In one or more embodiments of the present disclosure, when acquiring the public stream data of the second multi-person live broadcast room, the public stream pulling unit 602 is used to:

[0115] Acquire identification information of the public stream data;

[0116] After the server merges the plurality of second real-time multimedia streams to obtain the common stream data, the server acquires the common stream data from the server according to the identification information.

[0117] In one or more embodiments of the present disclosure, when acquiring the public stream data of the second multi-person live broadcast room, the public stream pulling unit 602 is used to:

[0118] In response to a mute instruction for a second multi-person live broadcast room, obtaining first-category public stream data for the second multi-person live broadcast room from a server, wherein the first-category public stream data is formed by combining real-time video streams of multiple live broadcast participant clients in the second multi-person live broadcast room with the server; or

[0119] In response to an unmute instruction to a second multi-person live broadcast room, second-category public stream data of the second multi-person live broadcast room is obtained from a server, wherein the second-category public stream data is formed by the server merging the real-time audio and video streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

[0120] In one or more embodiments of the present disclosure, when the control unit 603 stops acquiring and playing each of the second real-time multimedia streams, it is configured to:

[0121] After the first frame of the common stream data is decoded successfully, the acquisition and playback of the second real-time multimedia stream is stopped.

[0122] In one or more embodiments of the present disclosure, the common stream data carries audio and video status information and / or volume information of each of the second real-time multimedia streams;

[0123] When the control unit 603 controls the playing of the common stream data, it also includes:

[0124] The corresponding audio and video status information and / or volume information is displayed in the display area corresponding to each live broadcast participant in the public stream data.

[0125] In one or more embodiments of the present disclosure, when respectively acquiring each of the second real-time multimedia streams, the cross-room stream pulling unit 604 is configured to:

[0126] Pull each of the second real-time multimedia streams from the first multi-person live broadcast room on the server side, wherein each of the second real-time multimedia streams is a second real-time multimedia stream pushed by multiple live broadcast participant clients in the second multi-person live broadcast room to the first multi-person live broadcast room on the server side in response to the cross-room live broadcast instruction.

[0127] In one or more embodiments of the present disclosure, the live broadcast participant client further includes a streaming unit, which is used to:

[0128] In response to the cross-room microphone connection instruction, the first real-time multimedia stream collected in real time by the client of any live broadcast participant is pushed to the second multi-person microphone connection live broadcast room of the server.

[0129] In one or more embodiments of the present disclosure, the control unit 603 is further configured to:

[0130] If the common stream data fails to be played, the cross-room stream pulling unit 604 is controlled to obtain each of the second real-time multimedia streams and play them.

[0131] In one or more embodiments of the present disclosure, the streaming unit is further used for:

[0132] The first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and the public stream data are merged, and the merged multimedia stream is uploaded to the server end for being pushed by the server end to the audience client for playback.

[0133] The live broadcast participant client provided in this embodiment can be used to execute the technical solution of the method embodiment of the live broadcast participant client side. Its implementation principle and technical effects are similar, and this embodiment will not be repeated here.

[0134] Corresponding to the live broadcast and microphone connection method on the server side of the above embodiment, Figure 7 This is a structural block diagram of the server provided by the embodiment of the present disclosure. For the convenience of explanation, only the part related to the embodiment of the present disclosure is shown. Figure 7 The server 700 includes: a same-room streaming unit 701, a merging unit 702, and a public stream streaming unit 703.

[0135] The same-room streaming unit 701 is used to push the first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and the second real-time multimedia stream of each live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0136] The public stream push unit 703 is used to push the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room, and push the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room.

[0137] In addition, the server 700 also includes a merging unit 702, which is used to merge multiple real-time multimedia streams in the same multi-person live broadcast room to obtain public stream data corresponding to the first multi-person live broadcast room and public stream data corresponding to the second multi-person live broadcast room.

[0138] In one or more embodiments of the present disclosure, the server 700 further includes a cross-room streaming unit 704, which is used to:

[0139] Before pushing the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room, and before pushing the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room, based on the cross-room live broadcast instruction, the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room and the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room are respectively pushed to the live broadcast participant clients in the other multi-person live broadcast room.

[0140] In one or more embodiments of the present disclosure, the merging unit 702 is further used for:

[0141] In response to a mute instruction for any multi-person live broadcast room, real-time video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain first-category public stream data of the multi-person live broadcast room; or

[0142] In response to an unmute instruction for any multi-person live broadcast room, real-time audio and video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain second-category public stream data of the multi-person live broadcast room.

[0143] In one or more embodiments of the present disclosure, the merging unit 702 is further used for:

[0144] When obtaining the public stream data of any multi-person live broadcast room, the audio and video status information and / or volume information of the real-time multimedia stream of multiple live broadcast participant clients in the multi-person live broadcast room is obtained and carried in the public stream data.

[0145] In one or more embodiments of the present disclosure, the server further includes a viewer streaming unit, which is used to:

[0146] Merging the first public stream data and the second public stream data to obtain a merged multimedia stream, and pushing the merged multimedia stream to a viewer client for playback; or

[0147] Receive the merged multimedia stream uploaded by any live broadcast participant client, and push the merged multimedia stream to the audience client for playback, wherein the uploaded merged multimedia stream is a multimedia stream merged by the real-time multimedia streams of each live broadcast participant client in the multi-person live broadcast room where the live broadcast participant client is located and the public stream data of the other party's multi-person live broadcast room.

[0148] The server provided in this embodiment can be used to execute the technical solution of the above-mentioned server-side method embodiment. Its implementation principle and technical effects are similar, and this embodiment will not be repeated here.

[0149] refer to Figure 8, which shows a schematic diagram of the structure of an electronic device 800 suitable for implementing the embodiment of the present disclosure, and the electronic device 800 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0150] like Figure 8 As shown, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 to a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 are also stored in the RAM 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0151] Typically, the following devices may be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 808 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 8 The electronic device 800 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0152] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0153] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0154] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0155] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0156] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0157] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0158] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0159] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0160] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0161] In a first aspect, according to one or more embodiments of the present disclosure, a live broadcast and microphone connection method is provided, which is applied to any live broadcast participant client in a first multi-person microphone connection live broadcast room, and the method includes:

[0162] Acquire a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room, and play the stream;

[0163] Based on the cross-room live broadcast instruction, obtain public stream data of the second multi-person live broadcast room, wherein the public stream data is formed by merging second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room;

[0164] The common stream data is played.

[0165] According to one or more embodiments of the present disclosure, obtaining a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room includes:

[0166] A first real-time multimedia stream of at least one other live broadcast participant client except any one of the live broadcast participant clients in the first multi-person live broadcast room is obtained from the server.

[0167] According to one or more embodiments of the present disclosure, the method further includes:

[0168] Before obtaining the public stream data of the second multi-person live broadcast room, based on the cross-room live broadcast instruction, respectively obtain the second real-time multimedia stream and play it;

[0169] After playing the common stream data, stop acquiring and playing the second real-time multimedia stream.

[0170] According to one or more embodiments of the present disclosure, the acquiring public stream data of the second multi-person live broadcast room includes:

[0171] Acquire identification information of the public stream data;

[0172] After the server merges the plurality of second real-time multimedia streams to obtain the common stream data, the server acquires the common stream data from the server according to the identification information.

[0173] According to one or more embodiments of the present disclosure, the acquiring public stream data of the second multi-person live broadcast room includes:

[0174] In response to a mute instruction for a second multi-person live broadcast room, obtaining first-category public stream data for the second multi-person live broadcast room from a server, wherein the first-category public stream data is formed by combining real-time video streams of multiple live broadcast participant clients in the second multi-person live broadcast room with the server; or

[0175] In response to an unmute instruction to a second multi-person live broadcast room, second-category public stream data of the second multi-person live broadcast room is obtained from a server, wherein the second-category public stream data is formed by the server merging the real-time audio and video streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

[0176] According to one or more embodiments of the present disclosure, the stopping of acquiring and playing each of the second real-time multimedia streams includes:

[0177] After the first frame of the common stream data is decoded successfully, the acquisition and playback of each of the second real-time multimedia streams is stopped.

[0178] According to one or more embodiments of the present disclosure, the common stream data carries audio and video status information and / or volume information of a plurality of the second real-time multimedia streams;

[0179] When playing the common stream data, the method further includes:

[0180] The corresponding audio and video status information and / or volume information is displayed in the display area corresponding to each live broadcast participant in the public stream data.

[0181] According to one or more embodiments of the present disclosure, the step of respectively acquiring each of the second real-time multimedia streams includes:

[0182] Pull each of the second real-time multimedia streams from the first multi-person live broadcast room on the server side, wherein each of the second real-time multimedia streams is pushed by each live broadcast participant client in the second multi-person live broadcast room to the first multi-person live broadcast room on the server side in response to the cross-room live broadcast instruction.

[0183] According to one or more embodiments of the present disclosure, the method further includes:

[0184] In response to the cross-room microphone connection instruction, the first real-time multimedia stream collected in real time by the client of any live broadcast participant is pushed to the second multi-person microphone connection live broadcast room of the server.

[0185] According to one or more embodiments of the present disclosure, the method further includes:

[0186] If the common stream data fails to be played, the second real-time multimedia stream is obtained and played.

[0187] According to one or more embodiments of the present disclosure, the method further includes:

[0188] The first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and the public stream data are merged, and the merged multimedia stream is uploaded to the server end for being pushed by the server end to the audience client for playback.

[0189] In a second aspect, according to one or more embodiments of the present disclosure, a live broadcast and microphone connection device is provided, which is applied to a server, and the method includes:

[0190] Pushing a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0191] Based on the cross-room live broadcast instruction, the first public stream data corresponding to the first multi-person live broadcast room is pushed to the live broadcast participant client in the second multi-person live broadcast room, and the second public stream data corresponding to the second multi-person live broadcast room is pushed to the live broadcast participant client in the first multi-person live broadcast room.

[0192] According to one or more embodiments of the present disclosure, before pushing the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant client in the second multi-person live broadcast room, and pushing the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant client in the first multi-person live broadcast room, the method further includes:

[0193] Based on the cross-room live broadcast instruction, the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room and the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room are pushed to the live broadcast participant clients in the other multi-person live broadcast room respectively.

[0194] According to one or more embodiments of the present disclosure, the method further includes:

[0195] In response to a mute instruction for any multi-person live broadcast room, real-time video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain first-category public stream data of the multi-person live broadcast room; or

[0196] In response to an unmute instruction for any multi-person live broadcast room, real-time audio and video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain second-category public stream data of the multi-person live broadcast room.

[0197] According to one or more embodiments of the present disclosure, the method further includes:

[0198] When the public stream data of any multi-person live broadcast room is obtained by merging, the audio and video status information and / or volume information of the real-time multimedia streams of multiple live broadcast participant clients in the multi-person live broadcast room is obtained and carried in the public stream data.

[0199] According to one or more embodiments of the present disclosure, the method further includes:

[0200] Merging the first public stream data and the second public stream data to obtain a merged multimedia stream, and pushing the merged multimedia stream to a viewer client for playback; or

[0201] Receive the merged multimedia stream uploaded by any live broadcast participant client, and push the merged multimedia stream to the audience client for playback, wherein the uploaded merged multimedia stream is a multimedia stream merged by the real-time multimedia streams of each live broadcast participant client in the multi-person live broadcast room where the live broadcast participant client is located and the public stream data of the other party's multi-person live broadcast room.

[0202] In a third aspect, according to one or more embodiments of the present disclosure, a live broadcast participant client is provided, including:

[0203] The stream pulling unit in this room is used to obtain a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and play it;

[0204] A public stream pulling unit, configured to obtain public stream data of a second multi-person live broadcast room based on a cross-room live broadcast instruction, wherein the public stream data is a confluence of second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room;

[0205] A control unit is used to control the playing of the common stream data.

[0206] According to one or more embodiments of the present disclosure, when the local room stream pulling unit obtains the first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room, it is used to:

[0207] A first real-time multimedia stream of at least one other live broadcast participant client except any one of the live broadcast participant clients in the first multi-person live broadcast room is obtained from the server.

[0208] According to one or more embodiments of the present disclosure, the live broadcast participant client further includes a cross-room streaming unit, which is used to:

[0209] Before obtaining the public stream data of the second multi-person live broadcast room, based on the cross-room live broadcast instruction, respectively obtain each of the second real-time multimedia streams and play them;

[0210] The control unit is further configured to stop acquiring and playing each of the second real-time multimedia streams after playing the common stream data.

[0211] According to one or more embodiments of the present disclosure, when the public stream pulling unit obtains the public stream data of the second multi-person live broadcast room, it is used to:

[0212] Acquire identification information of the public stream data;

[0213] After the server merges the plurality of second real-time multimedia streams to obtain the common stream data, the server acquires the common stream data from the server according to the identification information.

[0214] According to one or more embodiments of the present disclosure, when the public stream pulling unit obtains the public stream data of the second multi-person live broadcast room, it is used to:

[0215] In response to a mute instruction for a second multi-person live broadcast room, obtaining first-category public stream data for the second multi-person live broadcast room from a server, wherein the first-category public stream data is formed by combining real-time video streams of multiple live broadcast participant clients in the second multi-person live broadcast room with the server; or

[0216] In response to an unmute instruction to a second multi-person live broadcast room, second-category public stream data of the second multi-person live broadcast room is obtained from a server, wherein the second-category public stream data is formed by the server merging the real-time audio and video streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

[0217] According to one or more embodiments of the present disclosure, when the control unit stops acquiring and playing each of the second real-time multimedia streams, it is configured to:

[0218] After the first frame of the common stream data is decoded successfully, the acquisition and playback of the second real-time multimedia stream is stopped.

[0219] According to one or more embodiments of the present disclosure, the common stream data carries audio and video status information and / or volume information of a plurality of the second real-time multimedia streams;

[0220] When the control unit controls the playing of the common stream data, it also includes:

[0221] The corresponding audio and video status information and / or volume information is displayed in the display area corresponding to each live broadcast participant in the public stream data.

[0222] According to one or more embodiments of the present disclosure, when the cross-room stream pulling unit obtains each of the second real-time multimedia streams respectively, it is used to:

[0223] Pull each of the second real-time multimedia streams from the first multi-person live broadcast room on the server side, wherein each of the second real-time multimedia streams is pushed by each live broadcast participant client in the second multi-person live broadcast room to the first multi-person live broadcast room on the server side in response to the cross-room live broadcast instruction.

[0224] According to one or more embodiments of the present disclosure, the live broadcast participant client further includes a streaming unit, which is used to:

[0225] In response to the cross-room microphone connection instruction, the first real-time multimedia stream collected in real time by the client of any live broadcast participant is pushed to the second multi-person microphone connection live broadcast room of the server.

[0226] According to one or more embodiments of the present disclosure, the control unit is further configured to:

[0227] If the public stream data fails to be played, the cross-room stream pulling unit is controlled again to obtain each of the second real-time multimedia streams and play them.

[0228] According to one or more embodiments of the present disclosure, the streaming unit is further used for:

[0229] The first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and the public stream data are merged, and the merged multimedia stream is uploaded to the server end for being pushed by the server end to the audience client for playback.

[0230] In a fourth aspect, according to one or more embodiments of the present disclosure, a server is provided, including:

[0231] The same-room streaming unit is used to push a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms;

[0232] The public stream pushing unit is used to push the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room based on the cross-room live broadcast instruction, and push the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room.

[0233] According to one or more embodiments of the present disclosure, the server further includes a cross-room streaming unit, which is used to:

[0234] Before pushing the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room, and before pushing the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room, based on the cross-room live broadcast instruction, the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room and the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room are respectively pushed to the live broadcast participant clients in the other multi-person live broadcast room.

[0235] According to one or more embodiments of the present disclosure, the confluence unit is further used for:

[0236] In response to a mute instruction for any multi-person live broadcast room, real-time video streams of German live broadcast participant clients in the multi-person live broadcast room are merged to obtain first-category public stream data of the multi-person live broadcast room; or

[0237] In response to an unmute instruction for any multi-person live broadcast room, real-time audio and video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain second-category public stream data of the multi-person live broadcast room.

[0238] According to one or more embodiments of the present disclosure, the confluence unit is further used for:

[0239] When obtaining the public stream data of any multi-person live broadcast room, the audio and video status information and / or volume information of the real-time multimedia stream of multiple live broadcast participant clients in the multi-person live broadcast room is obtained and carried in the public stream data.

[0240] According to one or more embodiments of the present disclosure, the server further includes a viewer streaming unit, which is used to:

[0241] Merging the first public stream data and the second public stream data to obtain a merged multimedia stream, and pushing the merged multimedia stream to a viewer client for playback; or

[0242] Receive the merged multimedia stream uploaded by any live broadcast participant client, and push the merged multimedia stream to the audience client for playback, wherein the uploaded merged multimedia stream is a multimedia stream merged by the real-time multimedia streams of each live broadcast participant client in the multi-person live broadcast room where the live broadcast participant client is located and the public stream data of the other party's multi-person live broadcast room.

[0243] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0244] The memory stores computer-executable instructions;

[0245] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect.

[0246] In a sixth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect is implemented.

[0247] In the seventh aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including computer execution instructions. When a processor executes the computer execution instructions, the live broadcast and microphone connection method described in the first aspect and various possible designs of the first aspect, or the live broadcast and microphone connection method described in the second aspect and various possible designs of the second aspect is implemented.

[0248] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0249] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0250] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A live broadcast method, characterized in that: Applied to any live broadcast participant client in the first multi-person live broadcast room, the method includes: Acquire a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room, and play the stream; Based on the cross-room live broadcast instruction, obtain public stream data of the second multi-person live broadcast room, wherein the public stream data is formed by merging second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room; The common stream data is played.

2. The method according to claim 1, characterized in that The step of obtaining a first real-time multimedia stream of at least one live broadcast participant client in a first multi-person live broadcast room includes: A first real-time multimedia stream of at least one other live broadcast participant client except any one of the live broadcast participant clients in the first multi-person live broadcast room is obtained from the server.

3. The method according to claim 1, characterized in that The method further comprises: Before obtaining the public stream data of the second multi-person live broadcast room, based on the cross-room live broadcast instruction, respectively obtain the second real-time multimedia stream and play it; After playing the common stream data, stop acquiring and playing the second real-time multimedia stream.

4. The method according to any one of claims 1 to 3, characterized in that: The obtaining of the public stream data of the second multi-person live broadcast room includes: Acquire identification information of the public stream data; After the server merges the plurality of second real-time multimedia streams to obtain the common stream data, the server acquires the common stream data from the server according to the identification information.

5. The method according to claim 1, characterized in that The obtaining of the public stream data of the second multi-person live broadcast room includes: In response to a mute instruction for a second multi-person live broadcast room, obtaining first-category public stream data for the second multi-person live broadcast room from a server, wherein the first-category public stream data is formed by combining real-time video streams of multiple live broadcast participant clients in the second multi-person live broadcast room with the server; or In response to an unmute instruction to a second multi-person live broadcast room, second-category public stream data of the second multi-person live broadcast room is obtained from a server, wherein the second-category public stream data is formed by the server merging the real-time audio and video streams of multiple live broadcast participant clients in the second multi-person live broadcast room.

6. The method according to claim 3, characterized in that The stopping of acquiring and playing the second real-time multimedia stream includes: After the first frame of the common stream data is decoded successfully, the acquisition and playback of the second real-time multimedia stream is stopped.

7. The method according to claim 1, characterized in that The common stream data carries the audio and video status information and / or volume information of each of the second real-time multimedia streams; When playing the common stream data, the method further includes: The corresponding audio and video status information and / or volume information is displayed in the display area corresponding to each live broadcast participant in the public stream data.

8. The method according to claim 3, characterized in that The obtaining the second real-time multimedia streams respectively includes: The second real-time multimedia stream is pulled from the first multi-person live broadcast room on the server side, wherein the second real-time multimedia stream is pushed by multiple live broadcast participant clients in the second multi-person live broadcast room to the first multi-person live broadcast room on the server side in response to the cross-room live broadcast instruction.

9. The method according to claim 8, characterized in that Also includes: In response to the cross-room microphone connection instruction, the first real-time multimedia stream collected in real time by the client of any live broadcast participant is pushed to the second multi-person microphone connection live broadcast room of the server.

10. The method according to any one of claims 1 to 3, characterized in that: Also includes: If the common stream data fails to be played, the second real-time multimedia stream is obtained and played.

11. The method according to claim 1, characterized in that: Also includes: The first real-time multimedia stream of each live broadcast participant client in the first multi-person live broadcast room and the public stream data are merged, and the merged multimedia stream is uploaded to the server end for being pushed by the server end to the audience client for playback.

12. A live broadcast method, characterized in that: Applied to the server, the method includes: Pushing a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms; Based on the cross-room live broadcast instruction, the first public stream data corresponding to the first multi-person live broadcast room is pushed to the live broadcast participant client in the second multi-person live broadcast room, and the second public stream data corresponding to the second multi-person live broadcast room is pushed to the live broadcast participant client in the first multi-person live broadcast room.

13. The method according to claim 12, characterized in that Before pushing the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant client in the second multi-person live broadcast room, and pushing the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant client in the first multi-person live broadcast room, the method further includes: Based on the cross-room live broadcast instruction, the first real-time multimedia stream of multiple live broadcast participant clients in the first multi-person live broadcast room and the second real-time multimedia stream of multiple live broadcast participant clients in the second multi-person live broadcast room are pushed to the live broadcast participant clients in the other multi-person live broadcast room respectively.

14. The method according to claim 12, characterized in that The method further comprises: In response to a mute instruction for any multi-person live broadcast room, real-time video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain first-category public stream data of the multi-person live broadcast room; or In response to an unmute instruction for any multi-person live broadcast room, real-time audio and video streams of multiple live broadcast participant clients in the multi-person live broadcast room are merged to obtain second-category public stream data of the multi-person live broadcast room.

15. The method according to any one of claims 12 to 14, characterized in that: Also includes: Merging the first public stream data and the second public stream data to obtain a merged multimedia stream, and pushing the merged multimedia stream to a viewer client for playback; or Receive the merged multimedia stream uploaded by any live broadcast participant client, and push the merged multimedia stream to the audience client for playback, wherein the uploaded merged multimedia stream is a multimedia stream merged by the real-time multimedia streams of each live broadcast participant client in the multi-person live broadcast room where the live broadcast participant client is located and the public stream data of the other party's multi-person live broadcast room.

16. A live broadcast participant client, characterized in that: include: The stream pulling unit in this room is used to obtain a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and play it; A public stream pulling unit, configured to obtain public stream data of a second multi-person live broadcast room based on a cross-room live broadcast instruction, wherein the public stream data is a confluence of second real-time multimedia streams of multiple live broadcast participant clients in the second multi-person live broadcast room; A control unit is used to control the playing of the common stream data.

17. A server, characterized in that: include: The same-room streaming unit is used to push a first real-time multimedia stream of at least one live broadcast participant client in the first multi-person live broadcast room and a second real-time multimedia stream of at least one live broadcast participant client in the second multi-person live broadcast room to the live broadcast participant clients in the respective multi-person live broadcast rooms; The public stream pushing unit is used to push the first public stream data corresponding to the first multi-person live broadcast room to the live broadcast participant clients in the second multi-person live broadcast room based on the cross-room live broadcast instruction, and push the second public stream data corresponding to the second multi-person live broadcast room to the live broadcast participant clients in the first multi-person live broadcast room.

18. An electronic device, characterized in that: include: at least one processor and memory; The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the method according to any one of claims 1 to 15.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the method according to any one of claims 1 to 15 is implemented.

20. A computer program product, characterized in that The method comprises computer-executable instructions, and when a processor executes the computer-executable instructions, the method according to any one of claims 1 to 15 is implemented.

Images