Live broadcast method and device, computer equipment and storage medium

Abstract

The embodiment of the invention discloses a live broadcast method and device, computer equipment and a storage medium, and belongs to the technical field of Internet. The method comprises the steps that a live broadcast room of a target object is displayed, first live broadcast data is played in the live broadcast room, a joint live broadcast entrance is displayed, the first live broadcast data is acquired by second equipment, and the first equipment and the second equipment log in based on the target object; acquiring second live broadcast data in response to a triggering operation on the joint live broadcast entrance; and fusing the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and sending the third live broadcast data to a server which is used for publishing the third live broadcast data in the live broadcast room. The combined live broadcast scheme provided by the embodiment of the invention can be realized without using professional live broadcast equipment, so that the requirement on the live broadcast equipment is reduced, and the application range of the combined live broadcast scheme is expanded.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of Internet technology, and in particular to a live broadcast method, apparatus, computer equipment and storage medium. Background Art

[0002] With the rapid development of Internet technology, live broadcast content is becoming more and more diverse, meeting people's demand for diversified live broadcast content. These endless live broadcast contents include game live broadcast, event live broadcast, etc. In game live broadcast or event live broadcast, the anchor usually explains the game or event. At present, such game live broadcast or event live broadcast requires professional live broadcast equipment to achieve, resulting in high requirements for live broadcast equipment and a narrow scope of application. Summary of the invention

[0003] The embodiments of the present application provide a live broadcast method, apparatus, computer equipment and storage medium, which can reduce the requirements for live broadcast equipment and increase the scope of application. The technical solution is as follows:

[0004] In one aspect, a live broadcast method is provided, which is performed by a first device, and the method includes:

[0005] A live broadcast room showing a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object;

[0006] In response to a triggering operation on the joint live broadcast entrance, collecting second live broadcast data;

[0007] The first live broadcast data and the second live broadcast data are merged to obtain third live broadcast data, and the third live broadcast data is sent to a server, and the server is used to publish the third live broadcast data in the live broadcast room.

[0008] On the other hand, a live broadcast method is provided, which is executed by a server, and the method includes:

[0009] When a first device enters a live broadcast room of a target object and a second device is performing a live broadcast based on the target object, first live broadcast data is sent to the first device, where the first live broadcast data is live broadcast data published in the live broadcast room and sent by the second device, and the first device logs in based on the target object;

[0010] receiving third live broadcast data, where the third live broadcast data is sent by the first device, the third live broadcast data is obtained by fusing the first live broadcast data and the second live broadcast data, and the second live broadcast data is collected by the first device when initiating a joint live broadcast;

[0011] The third live broadcast data is published in the live broadcast room.

[0012] On the other hand, a live broadcast method is provided, which is performed by a first device, and the method includes:

[0013] A live broadcast room showing a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object;

[0014] In response to a triggering operation on the joint live broadcast entrance, collecting second live broadcast data;

[0015] The second live broadcast data is sent to a server, and the server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

[0016] On the other hand, a live broadcast method is provided, which is executed by a server, and the method includes:

[0017] In the case of joint live broadcasting by the first device and the second device, first live broadcast data and second live broadcast data are received, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on the target object;

[0018] Merging the first live broadcast data with the second live broadcast data to obtain third live broadcast data;

[0019] The third live broadcast data is published in the live broadcast room of the target object.

[0020] On the other hand, a live broadcast apparatus is provided, which is configured in a first device, and the apparatus includes:

[0021] A display module, used for displaying a live broadcast room of a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object;

[0022] A collection module, configured to collect second live broadcast data in response to a trigger operation on the joint live broadcast entrance;

[0023] The sending module is used to merge the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and send the third live broadcast data to a server, and the server is used to publish the third live broadcast data in the live broadcast room.

[0024] In one possible implementation, the display module is used to send a live broadcast request to the server in response to a trigger operation on a live broadcast entrance in the display interface, and the live broadcast request is used to request a live broadcast based on the target object; in response to receiving a live broadcast failure information returned by the server, the live broadcast room is displayed, and the live broadcast failure information indicates that the target object is currently broadcasting live.

[0025] In another possible implementation, the first live broadcast data includes audio data and video data, and the second live broadcast data includes audio data; the sending module is used to mix the first audio data and the second audio data to obtain third audio data, the first audio data is the audio data in the first live broadcast data, and the second audio data is the audio data in the second live broadcast data; the third audio data and the first video data are encapsulated to obtain the third live broadcast data, and the first video data is the video data in the first live broadcast data.

[0026] In another possible implementation, the sending module is configured to perform echo cancellation on the second audio data based on the first audio data to obtain fourth audio data; and mix the fourth audio data and the first audio data to obtain the third audio data.

[0027] In another possible implementation, the sending module is used to adjust the volume of the first audio data and the volume of the second audio data so that the volume difference between the adjusted first audio data and the adjusted second audio data is less than a threshold; and mix the adjusted first audio data and the adjusted second audio data to obtain the third audio data.

[0028] In another possible implementation, the second live broadcast data also includes video data, and the sending module is used to merge the first video data and the second video data to obtain third video data, where the second video data is the video data in the second live broadcast data; and encapsulate the third audio data and the third video data to obtain the third live broadcast data.

[0029] On the other hand, a live broadcast device is provided, which is configured in a server, and the device includes:

[0030] A sending module, configured to send first live broadcast data to the first device when the first device enters the live broadcast room of a target object and the second device is performing live broadcast based on the target object, wherein the first live broadcast data is live broadcast data published in the live broadcast room and sent by the second device, and the first device logs in based on the target object;

[0031] a receiving module, configured to receive third live broadcast data, wherein the third live broadcast data is sent by the first device, the third live broadcast data is obtained by fusing the first live broadcast data and the second live broadcast data, and the second live broadcast data is collected by the first device when initiating a joint live broadcast;

[0032] A publishing module is used to publish the third live broadcast data in the live broadcast room.

[0033] On the other hand, a live broadcast apparatus is provided, which is configured in a first device, and the apparatus includes:

[0034] A display module, used for displaying a live broadcast room of a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object;

[0035] A collection module, configured to collect second live broadcast data in response to a trigger operation on the joint live broadcast entrance;

[0036] The sending module is used to send the second live broadcast data to the server, and the server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

[0037] On the other hand, a live broadcast device is provided, which is configured in a server, and the device includes:

[0038] A receiving module, configured to receive first live broadcast data and second live broadcast data when the first device and the second device jointly broadcast live, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on a target object;

[0039] A fusion module, used for fusing the first live broadcast data with the second live broadcast data to obtain third live broadcast data;

[0040] A publishing module is used to publish the third live broadcast data in the live broadcast room of the target object.

[0041] In a possible implementation, the publishing module is further configured to publish the first live broadcast data in the live broadcast room in response to receiving the first live broadcast data when the first device and the second device are not jointly live broadcasting and the second device is live broadcasting based on the target object;

[0042] The publishing module is used to switch the first live broadcast data published in the live broadcast room to the third live broadcast data when the third live broadcast data is obtained.

[0043] On the other hand, a computer device is provided, which includes a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the live broadcast method described in the above aspects.

[0044] On the other hand, a computer-readable storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the operations performed by the live broadcast method as described in the above aspects.

[0045] On the other hand, a computer program product is provided, including a computer program, which, when executed by a processor, implements the operations performed by the live broadcast method as described in the above aspects.

[0046] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also the joint live broadcast entrance can be displayed. Through the joint live broadcast entrance, the joint live broadcast of the first device and the second device can be quickly initiated. In the process of the joint live broadcast, the second device merges the collected second live broadcast data with the first live broadcast data collected by the first device, and then interacts with the server to publish the merged third live broadcast data in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the server to merge multiple live broadcast data of the object to save server resources, and can be implemented without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of this joint live broadcast solution. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 It is a structural diagram of an implementation environment provided by an embodiment of the present application;

[0049] Figure 2 is a flow chart of a live broadcast method provided by an embodiment of the present application;

[0050] Figure 3 is a flow chart of another live broadcast method provided by an embodiment of the present application;

[0051] Figure 4 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0052] Figure 5 This is a schematic diagram of a live broadcast room provided in an embodiment of the present application;

[0053] Figure 6 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0054] Figure 7 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0055] Figure 8 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0056] Fig. 9 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0057] Fig.10 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0058] Fig.11 is a flow chart of another live broadcast method provided in an embodiment of the present application;

[0059] Fig.12 It is a structural schematic diagram of a live broadcast device provided in an embodiment of the present application;

[0060] Fig.13 is a structural schematic diagram of another live broadcast device provided in an embodiment of the present application;

[0061] Fig.14 is a structural schematic diagram of another live broadcast device provided in an embodiment of the present application;

[0062] Fig.15 is a structural schematic diagram of another live broadcast device provided in an embodiment of the present application;

[0063] Fig.16 is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0064] Fig.17 It is a structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0065] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0066] The terms "first", "second", "third", "fourth", etc. used in this application may be used herein to describe various concepts, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of this application, the first audio may be referred to as the second audio, and similarly, the second audio may be referred to as the first audio.

[0067] The terms "at least one", "a plurality", "each", and "any" used in this application include one, two or more, a plurality includes two or more, each refers to each of the corresponding plurality, and any refers to any one of the plurality. For example, a plurality of objects includes three objects, and each refers to each of the three objects, and any refers to any one of the three objects, which can be the first object, the second object, or the third object.

[0068] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the objects and live broadcast data involved in this application are obtained with full authorization.

[0069] The live broadcast method provided in the embodiment of the present application can be executed by a computer device. Optionally, the computer device includes a first device or a server. Optionally, the server is an independent physical server, or it can be a server cluster or distributed system composed of multiple physical servers, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Server. Optionally, the first device is a terminal, which is a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, an intelligent voice interaction device, a smart home appliance, and a car terminal, etc., but is not limited to this.

[0070] In some embodiments, the computer program involved in the embodiments of the present application may be deployed on a server for execution, or on multiple servers located in one location, or on multiple servers distributed in multiple locations and interconnected by a communication network. Multiple servers distributed in multiple locations and interconnected by a communication network can constitute a blockchain system.

[0071] In some embodiments, the first device is provided as a first terminal and the second device is provided as a second terminal. Figure 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. Figure 1 , the implementation environment includes a first terminal 101, a second terminal 102 and a server 103. The first terminal 101 and the second terminal 102 are connected to the server 103 via a wireless or wired network.

[0072] The first terminal 101 and the second terminal 102 log in based on the target object, and both the first terminal 101 and the second terminal 102 can interact with the server 103 based on the logged-in target object to realize live broadcast. When the second terminal 102 broadcasts live based on the logged-in target object, it sends the first live data collected by the second terminal 102 to the server 103, and the server 103 publishes the first live data collected by the second terminal 102 in the live broadcast room of the target object, so that the audience terminal accessing the live broadcast room can play the first live data in the displayed live broadcast room. When the second terminal 102 is broadcasting live based on the logged-in target object, the first terminal 101 can enter the live broadcast room of the target object, so that the first terminal 101 displays the live broadcast room, plays the first live data in the live broadcast room and displays the joint live broadcast entrance. In addition, the first terminal 101 can initiate a joint live broadcast with the second terminal 102 through the joint live broadcast entrance in the displayed live broadcast room. During the joint live broadcast process, the first terminal 101 collects the second live broadcast data, and merges the first live broadcast data with the second live broadcast data. The server 103 publishes the merged third live broadcast data in the live broadcast room, so that the audience terminal accessing the live broadcast room can play the third live broadcast data in the displayed live broadcast room.

[0073] In a possible implementation, the first terminal 101 and the second terminal 102 are both installed with an application provided by the server 103, and the first terminal 101 and the second terminal 102 log in to the application based on the same object, and then live broadcast can be achieved through the application. For example, the application is a live broadcast application, and the live broadcast application has a live broadcast function. Of course, the live broadcast application can also have other functions, such as a review function, a shopping function, a navigation function, a game function, etc.

[0074] It should be noted that the embodiment of the present application is described by taking the example of the first terminal 101 fusing the first live broadcast data with the second live broadcast data. In another embodiment, when the first terminal 101 initiates a joint live broadcast with the second terminal 102, the first terminal 101 collects the second live broadcast data and sends the second live broadcast data to the server 103. The server 103 fuses the first live broadcast data and the second live broadcast data, and then publishes the fused third live broadcast data in the live broadcast room.

[0075] Figure 2 is a flowchart of a live broadcast method provided in an embodiment of the present application, the method is executed by a first device, such as Figure 2 As shown, the method includes:

[0076] 201. A first device displays a live broadcast room of a target object, in which first live broadcast data is played and a joint live broadcast entrance is displayed. The first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object.

[0077] In an embodiment of the present application, any object can be logged in by multiple devices at the same time, and the first device and the second device are logged in based on the same object. In the case where the second device broadcasts live based on the logged-in target object, the server has created a live broadcast room for the target object. During the live broadcast of the second device based on the target object, the first live broadcast data collected is sent to the server, and the server publishes the first live broadcast data in the live broadcast room. At this time, not only can the audience terminal enter the live broadcast room of the target object to play the live broadcast data in the live broadcast room; but also, the first device can enter the live broadcast room of the target object based on the logged-in target object. In the live broadcast room displayed by the first device, not only the first live broadcast data published in the live broadcast room is displayed, but also a joint live broadcast entrance can be displayed, so that the user can not only view the live broadcast of the target object through the first device, but also can realize the joint live broadcast of the first device and the second device through the joint live broadcast entrance later, that is, to realize the solution of joint live broadcast of different devices logged in to the same object.

[0078] Among them, the target object is an arbitrary object, for example, the target object is the anchor's account. The target object can be represented in any form. The first live broadcast data can be any type of data, for example, the first live broadcast data is data in a voice live broadcast scenario, and the first live broadcast data only includes audio data; or, the first live broadcast data is data in a video live broadcast scenario, and the first live broadcast data includes audio data and video data. For another example, the first live broadcast data is event live broadcast data or game live broadcast data. The joint live broadcast entrance can be represented in any form, for example, the joint live broadcast entrance is displayed in the form of a control. The joint live broadcast entrance is used to initiate the current device to conduct a joint live broadcast in the live broadcast room based on the object to which the live broadcast room belongs, that is, to initiate the first device and the second device to conduct a joint live broadcast based on the same object.

[0079] Joint live broadcast means that two devices can transmit live broadcast data to the same live broadcast room, and the live broadcast data of the two devices are played simultaneously in the live broadcast room.

[0080] For example, among two devices in a joint live broadcast, if one device collects sports game data, which includes game video data and game audio data, and the other device collects commentary audio data, the game video data, and the game audio data and commentary audio data are played in the same live broadcast room, that is, only the sports game screen is displayed in the live broadcast room, and the game sound and commentary are played at the same time.

[0081] For another example, for two devices jointly broadcasting, the live broadcast data collected by the two devices include video data and audio data. In the same live broadcast room, any video screen is embedded in any position of another video screen for display, that is, the two video screens are spliced ​​into one video screen for display, so as to achieve the simultaneous playback of two video data in the live broadcast room, and the simultaneous playback of the audio data contained in the two live broadcast data. For another example, two video screens are displayed in the live broadcast room in the form of large and small windows, one video screen fills the live broadcast room, and the other video screen is displayed in a small window. In addition, the user can switch the video screen displayed in the small window by triggering the operation, and can adjust the display position of the small window in the live broadcast room.

[0082] 202. The first device collects second live broadcast data in response to a trigger operation on the joint live broadcast portal.

[0083] In an embodiment of the present application, since the joint live broadcast entrance is used to initiate a joint live broadcast between the first device and the second device, once the first device detects the triggering operation on the joint live broadcast entrance, it is equivalent to receiving an instruction to conduct a joint live broadcast with the second device. The first device then collects the second live broadcast data so that the second live broadcast data and the first live broadcast data collected by the first device can be subsequently published in the live broadcast room of the target object to realize the joint live broadcast with the second device.

[0084] The second live broadcast data is any type of data, for example, the second live broadcast data includes audio data, or the second live broadcast data includes audio data and video data, etc. For example, the first live broadcast data is event live broadcast data, and the second live broadcast data is commentary audio data.

[0085] 203. The first device merges the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and sends the third live broadcast data to the server, which is used to publish the third live broadcast data in the live broadcast room.

[0086] In an embodiment of the present application, the first live broadcast data and the second live broadcast data are collected by different devices that log in to the target object. When the first device initiates a joint live broadcast with the second device, the first device can not only obtain the first live broadcast data currently released by the target object's live broadcast room, but also collect the second live broadcast data. The first live broadcast data and the second live broadcast data are fused, and the fused third live broadcast data is sent to the server. The server publishes the third live broadcast data in the live broadcast room, so that the audience terminals accessing the live broadcast room can directly play the live broadcast data jointly broadcast by the first device and the second device, and the server does not need to fuse multiple live broadcast data of the target object to save server resources.

[0087] For example, the first device is a first mobile phone, the second device is a second mobile phone, the first live broadcast data is sports game data, the sports game data includes sports game pictures and game audio, the second live broadcast data is commentary data, the commentary data includes commentary audio, the user broadcasts live based on the target object through the second mobile phone, collects sports game data, sends the sports game data to the server, and the server publishes the sports game data in the live broadcast room of the target object. Afterwards, the user logs in based on the target object through the first mobile phone, and enters the live broadcast room of the target object based on the target object. In the live broadcast room of the target object, not only the sports game data but also the joint live broadcast entrance are displayed. The user clicks on the joint live broadcast entrance to initiate a joint live broadcast based on the target object by two mobile phones. The user explains the sports game through the first mobile phone, the second mobile phone can collect the commentary data, and merge the commentary data with the sports game data, and send the merged third live broadcast data to the server, and the server publishes the third live broadcast data in the live broadcast room. The third live broadcast data includes sports game pictures, game audio and commentary audio. Then, the audience terminal entering the live broadcast room can not only play the sports game pictures and game audio, but also play the commentary audio.

[0088] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also the joint live broadcast entrance can be displayed. Through the joint live broadcast entrance, the joint live broadcast of the first device and the second device can be quickly initiated. In the process of the joint live broadcast, the second device merges the collected second live broadcast data with the first live broadcast data collected by the first device, and then interacts with the server to publish the merged third live broadcast data in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the server to merge multiple live broadcast data of the object to save server resources, and can be implemented without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of this joint live broadcast solution.

[0089] Figure 3 is a flowchart of another live broadcast method provided in an embodiment of the present application, the method is executed by a server, such as Figure 3 As shown, the method includes:

[0090] 301. When the first device enters the live broadcast room of the target object and the second device is performing a live broadcast based on the target object, the server sends first live broadcast data to the first device, where the first live broadcast data is the live broadcast data published in the live broadcast room and is sent by the second device, and the first device logs in based on the target object.

[0091] In the embodiment of the present application, any object can be logged in by multiple devices at the same time, and the first device and the second device are both logged in based on the target object. In the case where the second device is broadcasting live based on the logged-in target object, the first device can enter the live broadcast room of the target object based on the logged-in target object. At this time, the live broadcast data published in the live broadcast room is the second live broadcast data collected by the second device, and the server sends the first live broadcast data to the first device, so that the first device can play the first live broadcast data in the displayed live broadcast room, and display the joint live broadcast entrance in the live broadcast room, so as to subsequently initiate the joint live broadcast of the first device and the second device through the joint live broadcast entrance.

[0092] 302. The server receives third live broadcast data. The third live broadcast data is sent by the first device. The third live broadcast data is obtained by integrating the first live broadcast data and the second live broadcast data. The second live broadcast data is collected by the first device when initiating a joint live broadcast.

[0093] In an embodiment of the present application, when both the first device and the second device are logged in based on the target object and the second device is broadcasting live based on the target object, after the first device enters the live broadcast room of the target object, it can initiate a joint live broadcast of the first device and the second device. When the first device initiates a joint live broadcast with the second device, the first device not only collects the second live broadcast data, but also merges the second live broadcast data with the first live broadcast data collected by the second device, and sends the third live broadcast data obtained by the fusion to the server, so that the server can subsequently publish the third live broadcast data in the live broadcast room of the target object, thereby realizing the solution of joint live broadcast of the first device and the second device based on the same logged-in object.

[0094] 303. The server publishes the third live broadcast data in the live broadcast room.

[0095] In an embodiment of the present application, when the server receives the third live broadcast data sent by the first device, the first live broadcast data is no longer published in the live broadcast room, but the third live broadcast data is published in the live broadcast room, and the third live broadcast data is equivalent to the live broadcast data jointly broadcast by the first device and the second device, so that the audience terminal accessing the live broadcast room can directly play the live broadcast data jointly broadcast by the first device and the second device.

[0096] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object, and the server sends the first live broadcast data in the currently published live broadcast room to the first device. When the first device receives the first live broadcast data, it can initiate a joint live broadcast with the second device. When the first device initiates a joint live broadcast with the second device, the first device not only collects the second live broadcast data, but also merges the second live broadcast data with the first live broadcast data collected by the second device, and sends the merged third live broadcast data to the server, so that the server can subsequently publish the third live broadcast data in the live broadcast room of the target object. The third live broadcast data is equivalent to the live broadcast data of the joint live broadcast of the first device and the second device, thereby realizing the solution of the joint live broadcast of the first device and the second device based on the same logged-in object. This joint live broadcast solution does not require the server to merge multiple live broadcast data of the object to save server resources, and can be implemented without using professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of this joint live broadcast solution.

[0097] exist Figure 2 and Figure 3On the basis of the illustrated embodiment, in the embodiment of the present application, when the first device initiates a live broadcast through the live broadcast entrance in the display interface, if a second device that logs in to the same object as the first device performs a live broadcast, the first device will no longer start the live broadcast but enter the live broadcast room that has been created. The specific process is detailed in the following embodiment.

[0098] Figure 4 is a flowchart of another live broadcast method provided in an embodiment of the present application, the method is executed by the first device and the server, such as Figure 4 As shown, the method includes:

[0099] 401. In response to a trigger operation on a live broadcast entry in a display interface, a first device sends a live broadcast request to a server, where the live broadcast request is used to request live broadcast based on a target object.

[0100] In an embodiment of the present application, the first device can display a display interface, in which a live broadcast entrance is displayed. When a user triggers the live broadcast entrance in the display interface through the first device, the first device sends a live broadcast request to a server for providing live broadcast services to initiate a live broadcast based on the logged-in object.

[0101] The first device logs in based on the target object. The display interface is any interface. For example, the display interface is the main interface of the application. The main interface includes a live broadcast entrance and other information. For example, the main interface also includes other functional options or multiple live broadcast room logos that are being broadcast. For another example, the display interface is a functional interface of the application. The functional interface includes not only a live broadcast entrance, but also other functional options. The live broadcast entrance is used to initiate a live broadcast. The live broadcast entrance can be expressed in any form. For example, the live broadcast entrance is displayed in the form of a control.

[0102] In a possible implementation, the display interface is an interface in a live broadcast application, and after any device logs in to the live broadcast application based on an object, a live broadcast entrance can be displayed in the display interface, so as to initiate a live broadcast based on the logged-in object through the live broadcast entrance. For example, the first device displays a display interface through a live broadcast application, and a live broadcast entrance is displayed in the display interface.

[0103] 402. The server receives a live broadcast request sent by the first device, and sends live broadcast failure information to the first device when the second device is performing live broadcast based on the target object, where the live broadcast failure information indicates that the target object is performing live broadcast.

[0104] In an embodiment of the present application, the server is used to provide a live broadcast service. When the server receives a live broadcast request sent by a first device, the server verifies the target object carried in the live broadcast request to verify whether the target object is currently broadcasting live. If the target object is currently broadcasting live, and if it is determined that the second device is currently broadcasting live based on the target object, a live broadcast failure message is sent to the first device to indicate that the target object is currently broadcasting live and the first device can no longer start the live broadcast.

[0105] In a possible implementation, during the process of verifying the target object carried in the live broadcast request, the server also determines the device that is currently broadcasting the live broadcast based on the target object.

[0106] Optionally, the process of the server verifying the object includes: the server queries the live broadcast record based on the target object in the live broadcast request to determine whether the target object is currently broadcasting live and the device on which the target object is currently broadcasting live.

[0107] In an embodiment of the present application, a server is used to provide a live broadcast service, and a live broadcast record is stored in the server. The live broadcast record indicates an object that is broadcasting live and a device that is broadcasting live based on the object. Optionally, the live broadcast record includes an object and a corresponding device identifier to indicate that the device indicated by the device identifier is broadcasting live based on the object.

[0108] 403. In response to receiving the live broadcast failure information returned by the server, the first device displays the live broadcast room of the target object, in which the first live broadcast data is played and a joint live broadcast entrance is displayed. The first live broadcast data is collected by the second device, and the first device and the second device log in based on the target object.

[0109] In an embodiment of the present application, the first device receives the live broadcast failure information returned by the server and is able to determine that the target object is currently broadcasting live. The first device then enters the live broadcast room of the target object and displays the live broadcast room of the target object, so that the user can view the first live broadcast data being played through the live broadcast room displayed by the first device, and can initiate a joint live broadcast between the first device and the second device through the joint live broadcast entrance displayed in the live broadcast room. In addition, the user no longer needs to perform complex operations to enter the live broadcast room of the target object, thereby improving the convenience of entering the live broadcast room.

[0110] Among them, the first live broadcast data is the live broadcast data currently published in the live broadcast room of the target object. The first live broadcast data is collected by the second device. That is, in the process of the second device performing live broadcast based on the target object, it can collect the first live broadcast data and send the first live broadcast data to the server, so that the server publishes the first live broadcast data in the live broadcast room of the target object.

[0111] In one possible implementation, step 403 includes: the first device displays the live broadcast failure information in response to receiving the live broadcast failure information returned by the server, and displays the live broadcast room of the target object in response to a confirmation operation on the live broadcast failure information.

[0112] In the embodiment of the present application, since the live broadcast failure information indicates that the target object is broadcasting live, the first device detects the confirmation operation of the live broadcast failure information, which is equivalent to receiving an instruction to jump to the target object's live broadcast room. When the first device receives the live broadcast failure information, it not only displays the live broadcast failure information to prompt the target object that the live broadcast is being broadcast, but also jumps to the live broadcast room through the live broadcast failure information, so that the first device enters the target object's live broadcast room, without the user having to perform complex operations to enter the target object's live broadcast room, thereby improving the convenience of entering the live broadcast room.

[0113] Optionally, when the first device displays the live broadcast failure information, a confirmation option is displayed in the live broadcast failure information, and the first device displays the live broadcast room of the target object in response to the trigger operation of the confirmation option. In the embodiment of the present application, detecting the trigger operation of the confirmation option is equivalent to detecting the confirmation operation of the live broadcast failure information.

[0114] Optionally, if the live broadcast failure information includes a live broadcast room identifier, the process of displaying the live broadcast room of the target object includes: in response to a confirmation operation on the live broadcast failure information, sending a data acquisition request to the server, the data acquisition request carries the live broadcast room identifier, the server receives the data acquisition request, and based on the data acquisition request, sends the first live broadcast data corresponding to the live broadcast room identifier to the first device, the first device receives the first live broadcast data, displays the live broadcast room corresponding to the live broadcast room identifier, plays the first live broadcast data in the live broadcast room and displays a joint live broadcast entrance.

[0115] The live broadcast room identifier indicates the live broadcast room of the target object, the live broadcast room corresponding to the live broadcast room identifier is the live broadcast room of the target object, and the first live broadcast data corresponding to the live broadcast room identifier is the live broadcast data published in the live broadcast room of the target object. In the embodiment of the present application, when the live broadcast failure information is displayed, the first device can interact with the server through the live broadcast room identifier in the live broadcast failure information to obtain the live broadcast data of the live broadcast room from the server, and then display the live broadcast room of the target object.

[0116] Optionally, the data acquisition request also carries the login object of the first device. After receiving the data acquisition request, the server sends the first live broadcast data and entrance rendering data to the first device when it determines that the object in the data acquisition request and the object corresponding to the live broadcast room identifier in the data acquisition request are the same object. The first device displays the live broadcast room, plays the first live broadcast data in the live broadcast room, and renders a joint live broadcast entrance in the live broadcast room based on the entrance rendering data.

[0117] In an embodiment of the present application, the data acquisition request sent by the first device to the server carries the live broadcast room identifier and the first device login object, and the server will verify whether the object corresponding to the live broadcast room identifier is the same as the first device login object. If the object corresponding to the live broadcast room identifier is the same as the first device login object, indicating that the first device is qualified to initiate a joint live broadcast, the server will send entry rendering data to the first device so that the first device can render a joint live broadcast entry, so that the user can subsequently initiate a joint live broadcast through the joint live broadcast entry, thereby improving the convenience of initiating a joint live broadcast.

[0118] The entry rendering data is used to render the joint live broadcast entry, and the entry rendering data can be any data, for example, the entry rendering data indicates the display style of the joint live broadcast entry, the display position in the live broadcast room, etc. The object corresponding to the live broadcast room identifier indicates the object to which the live broadcast room corresponding to the live broadcast room identifier belongs.

[0119] In one possible implementation, step 403 includes: the first device displays the live broadcast failure information in response to receiving the live broadcast failure information returned by the server, displays the live broadcast room entrance of the target object in response to a query operation on the target object, and displays the live broadcast room of the target object in response to a trigger operation on the live broadcast room entrance.

[0120] In an embodiment of the present application, when the first device displays a live broadcast failure message, the user can learn that the object logged in by the first device is performing a live broadcast, and then query the target object's live broadcast room entrance through the target object logged in by the first device, so as to enter the target object's live broadcast room through the live broadcast room entrance.

[0121] In one possible implementation, the live broadcast room failure information includes a live broadcast room identifier. Step 403 includes: the first device displays the live broadcast failure information in response to receiving the live broadcast failure information returned by the server, displays the live broadcast room entrance of the target object in response to a query operation on the live broadcast room identifier, and displays the live broadcast room of the target object in response to a trigger operation on the live broadcast room entrance.

[0122] In an embodiment of the present application, the live broadcast room failure information includes a live broadcast room identification, which indicates the live broadcast room of the target object. When the first device displays the live broadcast failure information, the user can know that the object logged in by the first device is broadcasting live, and can know the live broadcast room identification. Then, the live broadcast room identification can be used to query the live broadcast room entrance of the target object, so that the first device can enter the live broadcast room of the target object through the live broadcast room entrance.

[0123] It should be noted that the embodiment of the present application is described by taking the example that the server sends live broadcast failure information to the first device when the second device is broadcasting live based on the target object. In another embodiment, the server sends live broadcast failure information and first live broadcast data to the first device when the second device is broadcasting live based on the target object. In response to the live broadcast failure information, the first device displays the live broadcast room of the target object based on the first live broadcast data and the live broadcast failure information, and plays the first live broadcast data in the live broadcast room.

[0124] It should be noted that in the embodiment of the present application, the first device displays the live broadcast room of the target object when the live broadcast request fails. In another embodiment, there is no need to execute the above steps 401-403, but other methods are adopted for the first device to display the live broadcast room of the target object.

[0125] 404. The first device collects second live broadcast data in response to a trigger operation on the joint live broadcast portal.

[0126] In a possible implementation, the first device is configured with a data acquisition module, and step 404 includes: the first device collects the second live broadcast data through the data acquisition module in response to a trigger operation on the joint live broadcast portal.

[0127] For example, the data acquisition module is a camera, a microphone, etc. configured for the first device. The first device can collect video data through the configured camera and can collect audio data through the microphone, and then use the collected video data and audio data as the collected second live broadcast data.

[0128] In one possible implementation, step 404 includes: the first device displays prompt information and collects second live broadcast data in response to a trigger operation on the joint live broadcast portal.

[0129] In the embodiment of the present application, the user triggers the joint live broadcast entrance through the first device, and the first device can display a prompt message to prompt that the joint live broadcast has been initiated and live broadcast data will be collected, and the first device will synchronously collect the second live broadcast data. By displaying the prompt message, the user can know whether the joint live broadcast is successfully initiated and is prompted to collect live broadcast data, thereby improving the user experience.

[0130] Optionally, the method for canceling the display of the prompt information includes: the first device cancels the display of the prompt information when the time length for displaying the prompt information reaches a time length threshold; or, the first device also displays a confirmation option when displaying the prompt information, and cancels the display of the prompt information in response to a triggering operation on the confirmation option.

[0131] For example, the live broadcast room displayed by the first device is as follows Figure 5As shown, the first device displays the live screen contained in the first live data in the live broadcast room, and plays the sound contained in the first live broadcast data. In addition, a "Start Explanation" button is displayed in the live broadcast room. The "Start Explanation" button is equivalent to the joint live broadcast entrance. The user clicks the "Start Explanation" button, and the first device displays a prompt message and a confirmation button. The prompt message is used to prompt that sound collection and uploading will start soon. The collected sound is equivalent to the second live broadcast data. After the user clicks the confirmation button, the prompt message is cancelled.

[0132] 405. The first device merges the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and sends the third live broadcast data to the server.

[0133] 406. The server is used to publish the third live broadcast data in the live broadcast room.

[0134] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also the joint live broadcast entrance can be displayed. Through the joint live broadcast entrance, the joint live broadcast of the first device and the second device can be quickly initiated. In the process of the joint live broadcast, the second device merges the collected second live broadcast data with the first live broadcast data collected by the first device, and then interacts with the server to publish the merged third live broadcast data in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the server to merge multiple live broadcast data of the object to save server resources, and can be implemented without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of this joint live broadcast solution.

[0135] In the above Figures 2 to 4 In the illustrated embodiment, both the first device and the second device log in based on the target object. When the first device enters the live broadcast room of the target object and the second device is broadcasting live based on the target object, the first device initiates a joint live broadcast with the first device through the joint live broadcast entrance. At this time, the second device is equivalent to the main device and the first device is equivalent to the auxiliary device. The main device is only used to collect live broadcast data and send the collected live broadcast data to the server, while the auxiliary device can not only collect live broadcast data, but also merge the collected live broadcast data with the live broadcast data collected by the main device, and send the merged live broadcast data to the server. In addition, both the main device and the auxiliary device can perform various management operations in the live broadcast room.

[0136] In an embodiment of the present application, when multiple devices log in based on the same object, after the first device among the multiple devices performs live broadcast based on the logged-in object, other devices initiate joint live broadcast based on the logged-in object, and the first device is used as the main device and the other devices are used as slave devices. Optionally, when the main device and multiple slave devices perform joint live broadcast, any of the multiple slave devices can fuse the live broadcast data collected by the main device and the multiple slave devices, and then send the fused live broadcast data to the server. Among them, any slave device that fuses the live broadcast data can be the first slave device or the last slave device, etc.

[0137] In one possible implementation, both the first device and the second device log in based on the target object. When the first device enters the live broadcast room of the target object and the second device is broadcasting live based on the target object, the first device initiates a joint live broadcast with the first device through the joint live broadcast entrance and sends a joint live broadcast notification to the server. In response to the joint live broadcast notification, the server adjusts the status of the second device to the main device status and the status of the first device to the secondary device status.

[0138] The master device status indicates that the first device first performs live broadcast based on the target object, and the slave device status indicates that the second device initiates a joint live broadcast based on the live broadcast based on the target object performed by the first device. The joint live broadcast notification indicates that the first device initiates a joint live broadcast with the second device.

[0139] In an embodiment of the present application, when the second device and the first device perform a joint live broadcast based on a target object, the server can maintain the status of the first device and the second device, so that it can be known which device first performs a live broadcast based on the target object and which device initiates the joint live broadcast based on the live broadcast of the target object by other devices through the status of the first device and the second device. When the first device initiates a joint live broadcast with the first device, the first device sends a joint live broadcast notification to the server, so that the server can respond to the joint live broadcast notification and maintain the status of the first device and the second device, so that the transmission of live broadcast data can be realized based on the status of the first device and the second device later.

[0140] For example, in the server dimension, when the live broadcast data of any device is switched to the master device state, the live broadcast data sent by the master device will no longer be published in the corresponding live broadcast room. Instead, the live broadcast data sent by the master device will be sent to the slave device. After receiving the live broadcast data sent by the slave device, the live broadcast data sent by the slave device will be published in the live broadcast room.

[0141] The embodiment of the present application provides a solution for joint live broadcasting by multiple devices logged in based on the same object. While the user is live broadcasting through any device, he can also enter the live broadcast room through other devices logged in based on the same object and initiate a joint live broadcast.

[0142] For example, taking the case where the first live broadcast data is sports game live broadcast data and the second live broadcast data includes commentary audio data, in the process of joint live broadcast through two devices, the main device collects the sports game live broadcast data, the secondary device collects the commentary audio data, the main device sends the sports game live broadcast data to the server, the server receives the sports game live broadcast data, sends the sports game live broadcast data to the secondary device, the secondary device receives the sports game live broadcast data, merges the commentary audio data with the sports game live broadcast data to encapsulate them into sports game live broadcast data including commentary, sends the sports game live broadcast data including commentary to the server, and the server publishes the sports game live broadcast data including commentary in the live broadcast room, so that the audience terminals entering the live broadcast room can play the sports game live broadcast data including commentary, thereby realizing the solution of configuring commentary for sports game live broadcast through independent devices.

[0143] It should be noted that the above Figure 4 In one embodiment, the first device displays the live broadcast room of the target object in response to the live broadcast failure information returned by the server. In another embodiment, the above steps 402-403 are not required to be performed, but other methods are adopted to display the live broadcast room of the target object.

[0144] In one possible implementation, the process of displaying the live broadcast room of the target object includes: the server receives a live broadcast request, and when the second device is broadcasting the target object live, sends live broadcast failure information and first live broadcast data to the first device; the first device displays the live broadcast room and the live broadcast failure information in response to receiving the live broadcast failure information returned by the server, and displays the first live broadcast data and the joint live broadcast entrance in the live broadcast room.

[0145] In the embodiment of the present application, when the server receives the live broadcast request sent by the first device, and the second device receives the instruction of the first device to enter the live broadcast room of the target object based on the fact that the target object is broadcasting live, the server sends the first live broadcast data to the first device. When the server determines that the target object is broadcasting live, the server sends the live broadcast failure information and the first live broadcast data to the first device, so that the first device not only displays the live broadcast failure information but also displays the live broadcast room of the target object, so that the user not only knows that the target object is broadcasting live, but also can view the live broadcast data in the live broadcast room, without the user having to perform complex operations to make the first device enter the live broadcast room, which improves the convenience of entering the live broadcast room and improves the efficiency of human-computer interaction.

[0146] It should be noted that the embodiment of the present application is described by taking the example that the server receives a live broadcast request sent by the first device, and the second device is broadcasting live based on the target object, which is equivalent to receiving an instruction for the first device to enter the live broadcast room of the target object. In another embodiment, the server can also take other methods to determine that the first device enters the live broadcast room of the target object. For example, when the first device enters the live broadcast room of the target object and the second device is broadcasting live based on the target object, the server sends the first live broadcast data to the first device.

[0147] It should be noted that the above Figures 2 to 4 The embodiment shown is described by taking the first device fusing the first live broadcast data and the second live broadcast data as an example. In another embodiment, the first device sends the collected second live broadcast data to the server when initiating a joint live broadcast with the second device, and the server fuses the first live broadcast data and the second live broadcast data. The specific process is described below. Figures 6 to 8 The embodiment shown.

[0148] Figure 6 is a flowchart of another live broadcast method provided in an embodiment of the present application, the method is executed by a first device, such as Figure 6 As shown, the method includes:

[0149] 601. The first device displays a live broadcast room of a target object, in which first live broadcast data is played and a joint live broadcast entrance is displayed. The first live broadcast data is collected by the second device, and the first device and the second device log in based on the target object.

[0150] 602. The first device collects second live broadcast data in response to a trigger operation on the joint live broadcast portal.

[0151] The steps 601-602 are similar to the above steps 201-202 and will not be described again.

[0152] 603. The first device sends the second live broadcast data to the server. The server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

[0153] In an embodiment of the present application, the first device and the second device log in based on the target object. When the first device initiates a joint live broadcast with the second device based on the target object, the first device collects the second live broadcast data and sends the second live broadcast data to the server. The server fuses the first live broadcast data and the second live broadcast data, and publishes the fused third live broadcast data in the live broadcast room, so that the audience terminals entering the live broadcast room can directly play the live broadcast data jointly broadcast by the first device and the second device. There is no need for the first device or the second device to fuse the first live broadcast data and the second live broadcast data, so as to save resources of the first device or the second device, reduce the performance requirements of the first device and the second device, and improve the scope of application of the joint live broadcast solution.

[0154] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also a joint live broadcast entrance can be displayed, so that the joint live broadcast entrance can be used to quickly initiate a joint live broadcast between the first device and the second device. The second device sends the collected second live broadcast data to the server, and the server merges the first live broadcast data with the second live broadcast data and publishes them in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the first device or the second device to merge the first live broadcast data and the second live broadcast data, so as to save resources of the first device or the second device, reduce the performance requirements of the first device and the second device, and can be realized without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of this joint live broadcast solution.

[0155] Figure 7 is a flowchart of another live broadcast method provided in an embodiment of the present application, the method is executed by a server, such as Figure 7 As shown, the method includes:

[0156] 701. When the first device and the second device jointly broadcast live, the server receives the first live broadcast data and the second live broadcast data, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on the target object.

[0157] In an embodiment of the present application, the first device and the second device are logged in based on the same object. When the first device and the second device jointly broadcast live, both the first device and the second device will collect live broadcast data, that is, the first device collects the second live broadcast data, and the second device collects the first live broadcast data, and sends the first live broadcast data and the second live broadcast data to the server, so that the server can subsequently merge the first live broadcast data and the second live broadcast data and publish them in the live broadcast room of the target object.

[0158] 702. The server merges the first live broadcast data and the second live broadcast data to obtain third live broadcast data.

[0159] 703. The server publishes the third live broadcast data in the live broadcast room of the target object.

[0160] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also a joint live broadcast entrance can be displayed, so that the joint live broadcast of the first device and the second device can be quickly initiated through the joint live broadcast entrance. During the joint live broadcast process, the second device sends the collected second live broadcast data to the server, and the server merges the first live broadcast data with the second live broadcast data and publishes them in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the first device or the second device to merge the first live broadcast data and the second live broadcast data, so as to save resources of the first device or the second device, reduce the performance requirements of the first device and the second device, and can be realized without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of the joint live broadcast solution.

[0161] In the above Figure 6 and Figure 7 On the basis of the shown embodiment, the embodiment of the present application can also, during the process of the second device performing live broadcast based on the target object, if the first device initiates a joint live broadcast with the second device, the server can switch the live broadcast data published in the live broadcast room of the target object to implement the joint live broadcast solution of the first device and the second device. The specific process is detailed in the following embodiment.

[0162] Figure 8 is a flowchart of another live broadcast method provided in an embodiment of the present application, the method is executed by a first device, a second device and a server, such as Figure 8 As shown, the method includes:

[0163] 801. During the live broadcast based on the target object, the second device collects first live broadcast data and sends the first live broadcast data to the server.

[0164] In an embodiment of the present application, the second device is logged in based on the target object, and the second device can initiate a live broadcast based on the logged-in object. During the process of the second device performing a live broadcast based on the logged-in object, the second device will collect live broadcast data and send the collected live broadcast data to the server, so that the server can subsequently publish the live broadcast data in the live broadcast room of the target object.

[0165] 802. When the first device and the second device are not jointly broadcasting and the second device is broadcasting live based on an object, in response to receiving the first live broadcast data, the server publishes the first live broadcast data in the live broadcast room.

[0166] In an embodiment of the present application, the first device and the second device are both logged in based on the target object. When the server receives the first live broadcast data sent by the second device, it will determine whether other devices logged in based on the target object are performing live broadcast. If only one device is performing live broadcast based on the target object, no other device is jointly broadcasting with the second device. That is, the first device logged in based on the target object does not jointly broadcast with the second device. After the server receives the live broadcast data sent by the device, it directly publishes the live broadcast data in the live broadcast room to enable the second device to perform live broadcast based on the target object.

[0167] In one possible implementation, step 802 includes: the server receives live broadcast data sent by the second device, queries the live broadcast record, and when it is determined that the first device and the second device are not jointly broadcasting and the second device is broadcasting live based on the object, in response to receiving the first live broadcast data, publishes the first live broadcast data in the live broadcast room.

[0168] In an embodiment of the present application, a server is used to provide a live broadcast service, and a live broadcast record is stored in the server. The live broadcast record indicates the object that is being broadcast live and the device that is broadcasting live based on the object. The server queries the live broadcast record to learn which devices are broadcasting live based on the target object, and then determines which devices are broadcasting live in conjunction with a second device based on the target object. Optionally, the live broadcast record includes the object and the corresponding device identifier to indicate that the device indicated by the device identifier is broadcasting live based on the object.

[0169] It should be noted that the embodiment of the present application is described by taking the case where both the first device and the second device log in based on the target object as an example. In another embodiment, if the other device and the second device log in based on the target object, the server will publish the first live broadcast data in the live broadcast room in response to receiving the first live broadcast data when it determines that the other device and the second device are not jointly broadcasting and the second device is broadcasting live based on the object.

[0170] 803. In response to a triggering operation on a live broadcast entry in the display interface, the first device sends a live broadcast request to the server, where the live broadcast request is used to request a live broadcast based on a target object.

[0171] 804. The server receives the live broadcast request sent by the first device, and when the second device is performing live broadcast based on the target object, sends live broadcast failure information to the first device, where the live broadcast failure information indicates that the target object is performing live broadcast.

[0172] 805. In response to receiving the live broadcast failure information returned by the server, the first device displays the live broadcast room of the target object, in which the first live broadcast data is played and a joint live broadcast entrance is displayed. The first live broadcast data is collected by the second device, and the first device and the second device log in based on the target object.

[0173] It should be noted that in an embodiment of the present application, the first device displays the live broadcast room of the target object when the live broadcast request fails. In another embodiment, there is no need to execute the above steps 803-805, but other methods are adopted for the first device to display the live broadcast room of the target object.

[0174] 806. In response to the triggering operation on the joint live broadcast entrance, the first device collects the second live broadcast data and sends the second live broadcast data to the server.

[0175] Steps 803-806 are similar to the above steps 401-404 and will not be described again.

[0176] 807. When the first device and the second device jointly broadcast live, the server receives the first live broadcast data and the second live broadcast data.

[0177] In an embodiment of the present application, when the second device is performing a live broadcast based on a target object, the server can receive the first live broadcast data collected by the second device in real time. When the first device initiates a joint live broadcast with the second device based on the target object, the first device will send the collected second live broadcast data to the server in real time, and the server can receive the second live broadcast data.

[0178] 808. The server merges the first live broadcast data with the second live broadcast data to obtain third live broadcast data.

[0179] 809. When the server obtains the third live broadcast data, it switches the first live broadcast data published in the live broadcast room of the target object to the third live broadcast data.

[0180] In an embodiment of the present application, when the first device and the second device are not jointly broadcasting and the second device is broadcasting live based on an object, the server publishes the first live broadcast data in the live broadcast room. When the first device and the second device are jointly broadcasting live, the server will merge the first live broadcast data and the second live broadcast data, and then switch the first live broadcast data published in the live broadcast room of the target object to the third live broadcast data, so that the audience terminal entering the live broadcast room can play the third live broadcast data, and the live broadcast data played in the same live broadcast room will change with the live broadcast data published by the live broadcast room, so that the audience terminal can automatically switch the live broadcast data played in the live broadcast room, thereby ensuring the accuracy of the live broadcast data published in the live broadcast room.

[0181] It should be noted that in an embodiment of the present application, when the server obtains the third live broadcast data, the server switches the first live broadcast data published in the live broadcast room to the third live broadcast data. In another embodiment, there is no need to execute the above step 809, but other methods are adopted to publish the third live broadcast data in the live broadcast room of the target object.

[0182] In the solution provided by the embodiment of the present application, any object can be logged in by multiple devices at the same time. When the first device and the second device log in based on the same object, when the second device broadcasts live based on the logged-in object, the first device can enter the live broadcast room of the object based on the logged-in object. In the live broadcast room, not only the live broadcast data collected by the second device is displayed, but also a joint live broadcast entrance can be displayed, so that the joint live broadcast of the first device and the second device can be quickly initiated through the joint live broadcast entrance. During the joint live broadcast process, the second device sends the collected second live broadcast data to the server, and the server merges the first live broadcast data with the second live broadcast data and publishes them in the live broadcast room, thereby realizing a solution for joint live broadcast of different devices logged in to the same object. This joint live broadcast solution does not require the first device or the second device to merge the first live broadcast data and the second live broadcast data, so as to save resources of the first device or the second device, reduce the performance requirements of the first device and the second device, and can be realized without the use of professional live broadcast equipment, thereby reducing the requirements for live broadcast equipment and improving the scope of application of the joint live broadcast solution.

[0183] It should be noted that in the above Figures 2 to 8 On the basis of the illustrated embodiment, the live broadcast data played in the live broadcast room displayed by the first device will change with the live broadcast data published by the live broadcast room. That is, when the server publishes the third live broadcast data in the live broadcast room of the target object, the server sends the third live broadcast data to the first device, and the first device switches the first live broadcast data played in the displayed live broadcast room to the third live broadcast data.

[0184] In the above Figures 2 to 8On the basis of the embodiment shown, the first live broadcast data includes audio data and video data, and the second live broadcast data includes audio data; the process of fusing the first live broadcast data and the second live broadcast data includes: mixing the first audio data and the second audio data to obtain third audio data, the first audio data is the audio data in the first live broadcast data, and the second audio data is the audio data in the second live broadcast data; encapsulating the third audio data and the first video data to obtain third live broadcast data, and the first video data is the video data in the first live broadcast data.

[0185] In an embodiment of the present application, the first live broadcast data includes audio data and video data, and the second live broadcast data includes audio data. The audio data in the first live broadcast data is first mixed with the audio data in the second live broadcast data, and then the mixed third audio data and the video data in the first live broadcast data are encapsulated into live broadcast data, so that the obtained third live broadcast data can simultaneously include the audio data in the first live broadcast data and the audio data in the second live broadcast data, and also include the video data in the first live broadcast data, thereby ensuring the accuracy of the obtained third live broadcast data.

[0186] In one possible implementation, the second live broadcast data also includes video data, and the process of obtaining the third live broadcast data includes: fusing the first video data with the second video data to obtain the third video data, where the second video data is the video data in the second live broadcast data; and encapsulating the third audio data and the third video data to obtain the third live broadcast data.

[0187] In an embodiment of the present application, when both the first live broadcast data and the second live broadcast data include video data and audio data, not only the audio data in the first live broadcast data is mixed with the audio data in the second live broadcast data, but also the video data in the first live broadcast data is fused with the video data in the second live broadcast data, and then the mixed third audio data and the fused third video data are encapsulated into live broadcast data, so that the obtained third live broadcast data can simultaneously include the audio data in the first live broadcast data and the audio data in the second live broadcast data, and can simultaneously include the video data in the first live broadcast data and the video data in the second live broadcast data, thereby ensuring the accuracy of the obtained third live broadcast data.

[0188] Optionally, the process of fusing the first video data with the second video data includes: converting the first video frame and the second video frame into texture data respectively, fusing the converted texture data to obtain fused texture data, and encoding the fused texture data to obtain a third video frame.

[0189] The first video frame is any video frame in the first video data, the second video frame is any video frame in the second video data, and the first video frame corresponds to the second video frame.

[0190] In an embodiment of the present application, the first video data corresponds to the video frames in the second video data one by one. According to the above method, the first video data and the corresponding video frames in the second video data are respectively fused to obtain multiple third video frames, and the third video data is composed of multiple third video frames.

[0191] For example, the first device converts the first video frame and the second video frame into texture data respectively, stores the texture data in the GPU (Graphics Processing Unit) video memory, and fuses the two converted texture data through the GPU based on OpenGL (OpenGraphics Library) Blend function to obtain fused texture data, and then uses the fused texture data as input of Media Codec (an encoder), and encodes the fused texture data through MediaCodec to obtain a third video frame.

[0192] In a possible implementation, the process of mixing the first audio data and the second audio data includes the following two methods.

[0193] The first method: based on the first audio data, the second audio data is echo-cancelled to obtain the fourth audio data; the fourth audio data and the first audio data are mixed to obtain the third audio data.

[0194] In an embodiment of the present application, when the first device collects the second live broadcast data, the first live broadcast data will be played in the displayed live broadcast room. The second audio data in the collected second live broadcast data may include the audio data in the first live broadcast data because, based on the first audio data, the second audio data is echo eliminated to eliminate the first audio data in the second audio data, thereby ensuring the accuracy of the fourth audio data obtained, and thereby ensuring the quality of the mixed third audio data.

[0195] In the embodiment of the present application, when a microphone is used to record the sound emitted by the anchor, since the sound of the speaker will also be recorded by the microphone, in order to obtain only the sound emitted by the anchor, the recorded audio data will be echo-cancelled to remove the sound played by the speaker recorded by the microphone. The first device can perform echo cancellation on the audio data through an echo cancellation module. For example, the echo cancellation module is VOICE_COMMUNICATION (a sound processing module).

[0196] In addition, when the first device uses a headset to record the sound emitted by the anchor, since there is no sound played by the speaker, the recorded first audio data does not need to be echo-cancelled.

[0197] The second method: adjusting the volume of the first audio data and the volume of the second audio data so that the volume difference between the adjusted first audio data and the adjusted second audio data is less than a threshold; mixing the adjusted first audio data and the adjusted second audio data to obtain third audio data.

[0198] In an embodiment of the present application, since the first live broadcast data and the second live broadcast data are collected by different devices, the volume of the audio data in the first live broadcast data and the audio data in the second live broadcast data may be different. When the difference between the volume of the first audio data and the volume of the second audio data is too large, when the subsequent audio data is mixed, the larger of the first audio data and the second audio data covers the smaller one. Therefore, the volume of the first audio data and the volume of the second audio data are adjusted so that the volume difference between the adjusted first audio data and the adjusted second audio data is less than a threshold value, and then the adjusted first audio data and the adjusted second audio data are mixed to ensure that the volume difference between the first audio data and the second audio data in the obtained third audio data is small, thereby ensuring the quality of the third audio data.

[0199] In the embodiment of the present application, since there is a difference in volume between the first audio data and the second audio data, when the volume difference between the first audio data and the second audio data is very large, the first audio data and the second audio data are directly mixed, so that the sound of the audio data with a smaller volume among the first audio data and the second audio data may be masked by the sound of the audio data with a larger volume, and the first device uses 16-bit data storage (-32768~32767) to save the first audio data or the second audio data. When the first audio data and the second audio data are mixed and exceed the data storage range, the mixed audio data will produce distortion / noise and other phenomena. Therefore, the volume of the first audio data and the second audio data is controlled.

[0200] In the embodiment of the present application, the volume of the first audio data and the second audio data is adjusted by gain control, so that before the first audio data and the second audio data are mixed, gain equalization is performed by dynamic compression and expansion algorithms to prevent sound masking and distortion / noise caused by value overflow. For example, the volume of audio data with a lower volume is amplified, or the volume of audio data with a higher volume is reduced.

[0201] It should be noted that the embodiments of the present application are only described using the above two methods as examples respectively. In another embodiment, the above two methods can be combined. That is, when the first audio data and the second audio data are mixed, the second audio data can be echo-cancelled, and the volume of the fourth audio data and the first audio data obtained after the echo cancellation can be adjusted, and the adjusted audio data can be mixed into the third audio data.

[0202] Based on the above-mentioned embodiments, the present application also provides a flowchart of another live broadcast method, taking the first device fusing the live broadcast data as an example. Figures 9 to 11 As shown, the method includes:

[0203] Step 1: The second device initiates a live broadcast based on the target object and sends a first live broadcast request to the server, where the first live broadcast request carries the target object.

[0204] Step 2: The server receives the first live broadcast request, and when it is determined that the target object is not currently broadcasting live, creates a live broadcast room for the target object, sends a live broadcast room identifier corresponding to the live broadcast room to the second device, and the second device receives the live broadcast room identifier and broadcasts live in the live broadcast room corresponding to the live broadcast room identifier, that is, the second device starts broadcasting successfully.

[0205] Step 3: During the live broadcast based on the target object, the first device collects the first live broadcast data in real time and sends the first live broadcast data to the server.

[0206] Step 4. The server receives the first live broadcast data, determines whether there are other devices logged in based on the target object, and determines whether other devices logged in based on the target object are conducting a joint live broadcast with the first device; if no other devices are logged in based on the target object, or if other devices logged in based on the target object do not conduct a joint live broadcast with the first device, the first live broadcast data is published in the live broadcast room of the target object.

[0207] Step 5: The first device initiates a live broadcast based on the target object and sends a second live broadcast request to the server, where the second live broadcast request carries the target object.

[0208] Step 6. The server receives the second live broadcast request, and when it is determined that the target object has already started live broadcast, sends live broadcast failure information and the live broadcast room identifier corresponding to the target object to the first device. The first device receives the live broadcast failure information and the live broadcast room identifier, and in response to the live broadcast failure information, displays the live broadcast room of the target object based on the live broadcast room identifier, plays the first live broadcast data in the live broadcast room, and displays the joint live broadcast entrance, that is, the first device fails to start broadcasting.

[0209] Among them, both the first device and the second device can perform management operations in the live broadcast room.

[0210] Step 7: In response to the triggering operation on the joint live broadcast entrance, the first device sends a joint live broadcast notification to the server, and the server adjusts the state of the first device to the master device state and the state of the second device to the slave device state in response to the joint live broadcast notification. That is, the first device is the master device of the target object, and the second device is the slave device of the target object.

[0211] Step 8. During the process of receiving the first live broadcast data sent by the second device in real time, when it is determined that the first device is logged in based on the target object and the first device and the second device are conducting a joint live broadcast, the server no longer publishes the first live broadcast data in the live broadcast room of the target object, but sends the first live broadcast data to the first device.

[0212] Step 9: The first device receives the first live broadcast data in real time, decapsulates the first live broadcast data to obtain the first video data stream and the first audio data stream contained in the first live broadcast data; decodes the first video data stream to obtain the first video data; decodes the first audio data stream to obtain the first audio data, and plays the first video data and the first audio data in the live broadcast room.

[0213] Step 10: The first device collects the second audio data and the second video data in real time, and based on the first audio data, performs echo cancellation on the second audio data to eliminate the first audio signal contained in the second audio data to obtain the fourth audio data; performs gain control on the first audio data and the fourth audio data to adjust the volume of the first audio data and the fourth audio data so that the volume difference between the adjusted first audio data and the adjusted fourth audio data is less than a threshold; and mixes the adjusted first audio data with the adjusted fourth audio data to obtain the third audio data. The first video data and the second video data are merged to obtain the third video data. The third audio data is encoded to obtain an audio data stream; the third video data is encoded to obtain a video data stream; the audio data stream and the video data stream are encapsulated to obtain the third live broadcast data, and the third live broadcast data is sent to the server.

[0214] The second audio data and the second video data can constitute the second live broadcast data. When the audio data stream and the video data stream are encapsulated, the third live broadcast data obtained can be data in any format. For example, the third live broadcast data is live broadcast data in FLV (FLASH VIDEO, a video format) format. By encapsulating the audio data stream and the video data stream, the data volume of the third live broadcast data obtained is compressed, so that less network resources are occupied when the third live broadcast data is subsequently transmitted, thereby ensuring the transmission efficiency of the third live broadcast data.

[0215] Step 11: The server receives the third live broadcast data sent by the first device, and pushes the third live broadcast data to the CDN (Content Delivery Network), which publishes the third live broadcast data in the live broadcast room.

[0216] Step 12: The viewer terminal enters the live broadcast room of the target object, pulls the third live broadcast data from the CDN, and plays the third live broadcast data in the live broadcast room.

[0217] It should be noted that the embodiment of the present application is described by taking the first device collecting the second video data and the second audio data as an example, while in another embodiment, the first device only collects the second audio data, and the third audio data and the first video data are encapsulated into the third live broadcast data.

[0218] In the related art, when any device broadcasts live based on the logged-in object, other devices can no longer log in to the object or broadcast live based on the object. In addition, although there is a solution in the related art for different devices to be connected to the microphone, that is, the live broadcast data of different devices participating in the connection are played simultaneously in the same live broadcast room, the different devices participating in the connection are logged in based on different objects. In the solution provided by the embodiment of the present application, when any object broadcasts live by itself, it can broadcast jointly through different devices logged in based on the object, and play the live broadcast data collected by different devices in the live broadcast room at the same time. In this way, different devices participating in the joint live broadcast can collect different live broadcast data, and then publish them in the same live broadcast room, so that when any object broadcasts live by itself, it can still publish a variety of live broadcast data in the live broadcast room, enriching the content contained in the live broadcast data in the live broadcast room and improving the live broadcast effect.

[0219] Moreover, different devices for joint live broadcast of the same object can be located in different regions, so that the live broadcast data collected in different regions can be published simultaneously in the live broadcast room of the same object, ensuring the flexibility of live broadcast.

[0220] For example, for a group, the group maintains an object for live broadcasting, so that when the audience views the live broadcast room of the object, they can know that the group is broadcasting live. Different members of the group use different mobile phones to log in based on the same object, and use different mobile phones to implement joint live broadcasting based on the same object. When different members use different mobile phones for joint live broadcasting, different mobile phones can be located in different regions, such as one member's mobile phone in the company, and another member's mobile phone in the workshop. In this way, there is no longer a limit on the region where the mobile phones used by members are located, so that members of the group can conduct joint live broadcasts based on the same object through different mobile phones anywhere, ensuring the flexibility of live broadcasting.

[0221] Moreover, the providing method provided by the embodiment of the present application can be applied to a variety of scenarios. For the live broadcasting scenario of large-scale events, professional live broadcasting equipment is required in the relevant technology to broadcast live at the scene of the game. Of course, the anchor can also broadcast live at the scene of the game through a handheld terminal, etc. However, due to the noisy sound at the scene of the game, when the anchor broadcasts live at the scene of the game through a handheld terminal, the live broadcast effect will be poor. The joint live broadcasting scheme provided by the embodiment of the present application is applied in the live broadcasting scenario of large-scale events. During the process of the user broadcasting live based on the same object through the first device and the second device, the first device is located at the scene of the game and can collect the live broadcasting data of the event. The second device is located at the home of the anchor. The anchor can interpret the live broadcasting data of the competition system through the second device. The second device uses the collected commentary audio as the second live broadcasting data, and then the second device encapsulates the live broadcasting data of the event and the commentary audio into the third live broadcasting data, sends the third live broadcasting data to the server, and the server publishes the third live broadcasting data in the live broadcasting room of the object. Then the audience terminal entering the live broadcasting room can play the third live broadcasting data, and the audience can not only watch the live broadcasting data of the event through the audience terminal, but also listen to the commentary audio, which provides convenience for configuring the commentary of the live broadcasting of the event. In this way, the anchor does not need to use professional live broadcast equipment to broadcast live at the game site. He only needs to place the first device at the game site to comment on the game at home. There is no need to use a handheld terminal to broadcast live at the game site, and the clarity of the commentary audio can be guaranteed, thereby ensuring the live broadcast effect. In addition, there is no need for other anchors to cooperate to achieve joint live broadcast, so that the anchor can realize the event broadcast plan by logging into two devices of the same object.

[0222] In addition, the second device can also collect video data including the anchor's screen, and use the commentary audio and the video data as the second live data, so that the audience can not only watch the live data of the event and the anchor's screen through the audience terminal, but also listen to the commentary audio.

[0223] Fig.12 is a structural diagram of a live broadcast device provided in an embodiment of the present application, such as Fig.12 As shown, configured in a first device, the device includes:

[0224] Display module 1201, used for displaying a live broadcast room of a target object, in which first live broadcast data is played and a joint live broadcast entrance is displayed, the first live broadcast data is collected by a second device, and the first device and the second device are logged in based on the target object;

[0225] The collection module 1202 is used to collect the second live broadcast data in response to the triggering operation on the joint live broadcast entrance;

[0226] The sending module 1203 is used to merge the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and send the third live broadcast data to the server, and the server is used to publish the third live broadcast data in the live broadcast room.

[0227] In one possible implementation, the display module 1201 is used to send a live broadcast request to the server in response to a trigger operation on the live broadcast entrance in the display interface, and the live broadcast request is used to request a live broadcast based on the target object; in response to receiving the live broadcast failure information returned by the server, the live broadcast room is displayed, and the live broadcast failure information indicates that the target object is currently broadcasting live.

[0228] In another possible implementation, the first live broadcast data includes audio data and video data, and the second live broadcast data includes audio data; the sending module 1203 is used to mix the first audio data and the second audio data to obtain third audio data, the first audio data is the audio data in the first live broadcast data, and the second audio data is the audio data in the second live broadcast data; the third audio data and the first video data are encapsulated to obtain third live broadcast data, and the first video data is the video data in the first live broadcast data.

[0229] In another possible implementation, the sending module 1203 is configured to perform echo cancellation on the second audio data based on the first audio data to obtain fourth audio data; and mix the fourth audio data and the first audio data to obtain third audio data.

[0230] In another possible implementation, the sending module 1203 is used to adjust the volume of the first audio data and the volume of the second audio data so that the volume difference between the adjusted first audio data and the adjusted second audio data is less than a threshold; and mix the adjusted first audio data and the adjusted second audio data to obtain third audio data.

[0231] In another possible implementation, the second live broadcast data also includes video data, and the sending module 1203 is used to merge the first video data and the second video data to obtain third video data, where the second video data is the video data in the second live broadcast data; and encapsulate the third audio data and the third video data to obtain third live broadcast data.

[0232] It should be noted that the live broadcast device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the first device is divided into different functional modules to complete all or part of the functions described above. In addition, the live broadcast device provided in the above embodiment and the live broadcast method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0233] Fig.13 is a structural diagram of another live broadcast device provided in an embodiment of the present application, such as Fig.13 As shown, configured in a server, the device includes:

[0234] A sending module 1301 is used to send first live broadcast data to the first device when the first device enters the live broadcast room of the target object and the second device is performing live broadcast based on the target object, where the first live broadcast data is live broadcast data published in the live broadcast room and sent by the second device, and the first device logs in based on the target object;

[0235] The receiving module 1302 is used to receive third live broadcast data, where the third live broadcast data is sent by the first device, the third live broadcast data is obtained by integrating the first live broadcast data and the second live broadcast data, and the second live broadcast data is collected by the first device when initiating a joint live broadcast;

[0236] The publishing module 1303 is used to publish the third live broadcast data in the live broadcast room.

[0237] It should be noted that the live broadcast device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. In addition, the live broadcast device provided in the above embodiment and the live broadcast method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0238] Fig.14 is a structural diagram of another live broadcast device provided in an embodiment of the present application, such as Fig.14 As shown, configured in a first device, the device includes:

[0239] Display module 1401, used for displaying a live broadcast room of a target object, in which first live broadcast data is played and a joint live broadcast entrance is displayed, the first live broadcast data is collected by the second device, and the first device and the second device are logged in based on the target object;

[0240] The collection module 1402 is used to collect the second live broadcast data in response to the triggering operation on the joint live broadcast entrance;

[0241] The sending module 1403 is used to send the second live broadcast data to the server, and the server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

[0242] It should be noted that the live broadcast device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the first device is divided into different functional modules to complete all or part of the functions described above. In addition, the live broadcast device provided in the above embodiment and the live broadcast method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0243] Fig.15 is a structural diagram of another live broadcast device provided in an embodiment of the present application, such as Fig.15 As shown, configured in a server, the device includes:

[0244] The receiving module 1501 is used to receive the first live broadcast data and the second live broadcast data when the first device and the second device jointly broadcast, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on the target object;

[0245] A fusion module 1502 is used to fuse the first live broadcast data with the second live broadcast data to obtain third live broadcast data;

[0246] The publishing module 1503 is used to publish the third live broadcast data in the live broadcast room of the target object.

[0247] In a possible implementation, the publishing module 1503 is further configured to publish the first live broadcast data in the live broadcast room in response to receiving the first live broadcast data when the first device and the second device are not jointly live broadcasting and the second device is live broadcasting based on the target object;

[0248] The publishing module 1503 is used to switch the first live broadcast data published in the live broadcast room to the third live broadcast data when the third live broadcast data is obtained.

[0249] It should be noted that the live broadcast device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. In addition, the live broadcast device provided in the above embodiment and the live broadcast method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0250] An embodiment of the present application also provides a computer device, which includes a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the live broadcast method of the above embodiment.

[0251] Optionally, the computer device is the first device, and the first device is provided as a terminal. Fig.16 The structure block diagram of a terminal 1600 provided by an exemplary embodiment of the present application is shown. The terminal 1600 includes: a processor 1601 and a memory 1602 .

[0252] Processor 1601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. Processor 1601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, processor 1601 may be integrated with a GPU, which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, processor 1601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0253] The memory 1602 may include one or more computer-readable storage media, which may be non-transitory. The memory 1602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1602 is used to store at least one computer program, which is used to be executed by the processor 1601 to implement the live broadcast method provided in the method embodiment of the present application.

[0254] In some embodiments, the terminal 1600 may further optionally include: a peripheral device interface 1603 and at least one peripheral device. The processor 1601, the memory 1602 and the peripheral device interface 1603 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1603 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1604, a display screen 1605, a camera assembly 1606, an audio circuit 1607 and a power supply 1608.

[0255] The peripheral device interface 1603 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1601 and the memory 1602. In some embodiments, the processor 1601, the memory 1602, and the peripheral device interface 1603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1601, the memory 1602, and the peripheral device interface 1603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0256] The radio frequency circuit 1604 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1604 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1604 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1604 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1604 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1604 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0257] The display screen 1605 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1605 is a touch display screen, the display screen 1605 also has the ability to collect touch signals on the surface or above the surface of the display screen 1605. The touch signal can be input to the processor 1601 as a control signal for processing. At this time, the display screen 1605 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1605 can be one, set on the front panel of the terminal 1600; in other embodiments, the display screen 1605 can be at least two, respectively set on different surfaces of the terminal 1600 or in a folding design; in other embodiments, the display screen 1605 can be a flexible display screen, set on a curved surface or a folding surface of the terminal 1600. Even, the display screen 1605 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1605 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0258] The camera assembly 1606 is used to capture images or videos. Optionally, the camera assembly 1606 includes a front camera and a rear camera. The front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1606 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0259] The audio circuit 1607 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1601 for processing, or input them into the radio frequency circuit 1604 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1600. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1601 or the radio frequency circuit 1604 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1607 may also include a headphone jack.

[0260] The power supply 1608 is used to power various components in the terminal 1600. The power supply 1608 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1608 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0261] Those skilled in the art will understand that Fig.16 The structure shown in the figure does not constitute a limitation on the terminal 1600, and the terminal 1600 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0262] Optionally, the computer device is provided as a server. Fig.17 This is a schematic diagram of the structure of a server provided in an embodiment of the present application. The server 1700 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 1701 and one or more memories 1702, wherein at least one computer program is stored in the memory 1702, and at least one computer program is loaded and executed by the processor 1701 to implement the methods provided in the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output, and the server may also include other components for implementing device functions, which will not be described in detail here.

[0263] An embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the operations performed by the live broadcast method of the above embodiment.

[0264] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the operations performed by the live broadcast method of the above embodiment.

[0265] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0266] The above description is only an optional embodiment of the embodiments of the present application and is not intended to limit the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the present application.

Claims

1. A live broadcast method, characterized in that: Executed by a first device, the method includes: A live broadcast room showing a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object; In response to a triggering operation on the joint live broadcast entrance, collecting second live broadcast data; The first live broadcast data and the second live broadcast data are merged to obtain third live broadcast data, and the third live broadcast data is sent to a server, and the server is used to publish the third live broadcast data in the live broadcast room.

2. The method according to claim 1, characterized in that The live broadcast room displaying the target object includes: In response to a triggering operation on a live broadcast entrance in the display interface, a live broadcast request is sent to the server, where the live broadcast request is used to request a live broadcast based on the target object; In response to receiving the live broadcast failure information returned by the server, the live broadcast room is displayed, and the live broadcast failure information indicates that the target object is currently broadcasting live.

3. The method according to claim 1, characterized in that The first live broadcast data includes audio data and video data, and the second live broadcast data includes audio data; the first live broadcast data and the second live broadcast data are merged to obtain the third live broadcast data, including: The first audio data and the second audio data are mixed to obtain third audio data, wherein the first audio data is audio data in the first live broadcast data, and the second audio data is audio data in the second live broadcast data; The third audio data and the first video data are encapsulated to obtain the third live broadcast data, wherein the first video data is the video data in the first live broadcast data.

4. The method according to claim 3, characterized in that The mixing of the first audio data and the second audio data to obtain the third audio data includes: Based on the first audio data, performing echo cancellation on the second audio data to obtain fourth audio data; The fourth audio data and the first audio data are mixed to obtain the third audio data.

5. The method according to claim 3, characterized in that: The mixing of the first audio data and the second audio data to obtain the third audio data includes: Adjusting the volume of the first audio data and the volume of the second audio data so that a difference between the adjusted volumes of the first audio data and the adjusted volume of the second audio data is less than a threshold; The adjusted first audio data and the adjusted second audio data are mixed to obtain the third audio data.

6. The method according to claim 3, characterized in that The second live broadcast data also includes video data, and the third audio data and the first video data are encapsulated to obtain the third live broadcast data, including: The first video data and the second video data are merged to obtain third video data, where the second video data is the video data in the second live broadcast data; The third audio data and the third video data are encapsulated to obtain the third live broadcast data.

7. A live broadcast method, characterized in that: Executed by a server, the method includes: When a first device enters a live broadcast room of a target object and a second device is performing a live broadcast based on the target object, first live broadcast data is sent to the first device, where the first live broadcast data is live broadcast data published in the live broadcast room and sent by the second device, and the first device logs in based on the target object; receiving third live broadcast data, where the third live broadcast data is sent by the first device, the third live broadcast data is obtained by fusing the first live broadcast data and the second live broadcast data, and the second live broadcast data is collected by the first device when initiating a joint live broadcast; The third live broadcast data is published in the live broadcast room.

8. A live broadcast method, characterized in that: Executed by a first device, the method includes: A live broadcast room showing a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object; In response to a triggering operation on the joint live broadcast entrance, collecting second live broadcast data; The second live broadcast data is sent to a server, and the server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

9. A live broadcast method, characterized in that: Executed by a server, the method includes: In the case of joint live broadcasting by the first device and the second device, first live broadcast data and second live broadcast data are received, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on the target object; Merging the first live broadcast data with the second live broadcast data to obtain third live broadcast data; The third live broadcast data is published in the live broadcast room of the target object.

10. The method according to claim 9, characterized in that In the case where the first device and the second device jointly broadcast live, before receiving the first live broadcast data and the second live broadcast data, the method further includes: In a case where the first device and the second device are not jointly broadcasting and the second device is broadcasting live based on the target object, in response to receiving the first live broadcast data, publishing the first live broadcast data in the live broadcast room; The step of publishing the third live broadcast data in the live broadcast room of the target object includes: When the third live broadcast data is obtained, the first live broadcast data published in the live broadcast room is switched to the third live broadcast data.

11. A live broadcast device, characterized in that: Configured in a first device, the apparatus comprises: A display module, used for displaying a live broadcast room of a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object; A collection module, configured to collect second live broadcast data in response to a trigger operation on the joint live broadcast entrance; The sending module is used to merge the first live broadcast data and the second live broadcast data to obtain third live broadcast data, and send the third live broadcast data to a server, and the server is used to publish the third live broadcast data in the live broadcast room.

12. A live broadcast device, characterized in that: Configured in a server, the device comprises: A sending module, configured to send first live broadcast data to the first device when the first device enters the live broadcast room of a target object and the second device is performing live broadcast based on the target object, wherein the first live broadcast data is live broadcast data published in the live broadcast room and sent by the second device, and the first device logs in based on the target object; a receiving module, configured to receive third live broadcast data, wherein the third live broadcast data is sent by the first device, the third live broadcast data is obtained by fusing the first live broadcast data and the second live broadcast data, and the second live broadcast data is collected by the first device when initiating a joint live broadcast; A publishing module is used to publish the third live broadcast data in the live broadcast room.

13. A live broadcast device, characterized in that: Configured in a first device, the apparatus comprises: A display module, used for displaying a live broadcast room of a target object, wherein the live broadcast room plays first live broadcast data and displays a joint live broadcast entrance, wherein the first live broadcast data is collected by a second device, and the first device and the second device log in based on the target object; A collection module, configured to collect second live broadcast data in response to a trigger operation on the joint live broadcast entrance; The sending module is used to send the second live broadcast data to the server, and the server is used to merge the first live broadcast data and the second live broadcast data, and publish the merged third live broadcast data in the live broadcast room.

14. A live broadcast device, characterized in that: Configured in a server, the device comprises: A receiving module, configured to receive first live broadcast data and second live broadcast data when the first device and the second device jointly broadcast live, the second live broadcast data is sent by the first device, the first live broadcast data is sent by the second device, and the first device and the second device log in based on a target object; A fusion module, used for fusing the first live broadcast data with the second live broadcast data to obtain third live broadcast data; A publishing module is used to publish the third live broadcast data in the live broadcast room of the target object.

15. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the live broadcast method as described in any one of claims 1 to 6; or, to implement the operations performed by the live broadcast method as described in claim 7; or, to implement the operations performed by the live broadcast method as described in claim 8; or, to implement the operations performed by the live broadcast method as described in any one of claims 9 to 10.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the live broadcast method as described in any one of claims 1 to 6; or, to implement the operations performed by the live broadcast method as described in claim 7; or, to implement the operations performed by the live broadcast method as described in claim 8; or, to implement the operations performed by the live broadcast method as described in any one of claims 9 to 10.

17. A computer program product comprising a computer program, characterized in that When the computer program is executed by the processor, it implements the operations performed by the live broadcast method as described in any one of claims 1 to 6; or, it implements the operations performed by the live broadcast method as described in claim 7; or, it implements the operations performed by the live broadcast method as described in claim 8; or, it implements the operations performed by the live broadcast method as described in any one of claims 9 to 10.

Images