Method and device for displaying and sending bullet screen in live broadcast and microphone connection
By turning on the split screen mode on the terminal device and displaying the barrage information of the two anchors, the problem that users in the live broadcast room cannot interact directly is solved, and the user experience and interactivity are improved.
Patent Information
- Application Number
- CN202111413864.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-25
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2041-11-25
AI Technical Summary
When anchor A and anchor B interact in a network connection, users in the live broadcast room cannot interact directly, resulting in insufficient interaction between users and poor user experience.
By turning on the split screen mode on the terminal device, the barrage information associated with the two anchors is received and displayed, and the barrage of the first anchor and the second anchor is displayed in two areas of the screen respectively.
The barrage of two anchors is displayed on the screen in split screen, allowing the audience to interact, improve the interactivity between the audience, and enhance the user experience.
Smart Images

Figure CN116170607B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of video technology, and in particular to a method and device for displaying and sending barrage in live broadcast and microphone connection. Background Art
[0002] When the anchor is broadcasting live in the live broadcast room, he often interacts with other anchors through the microphone. For example, anchor A can interact with anchor B through the microphone when broadcasting live. However, the inventor found that when anchor A and anchor B interact through the microphone, users who watch anchor A's live video in the live broadcast room can only interact with other users in the live broadcast room through the bullet screen. Users who watch anchor B's live video in another live broadcast room can only interact with other users in the live broadcast room through the bullet screen. In other words, although the two anchors are interacting through the microphone, their respective live broadcast users cannot interact directly, resulting in insufficient interactivity between users and poor user experience. Summary of the invention
[0003] In view of this, a method, device, computer equipment and computer-readable storage medium for displaying and playing barrage in live broadcast and microphone connection are now provided to solve the problem that in the existing live broadcast and microphone connection process, the live broadcast users of both parties cannot interact directly, resulting in insufficient interactivity between users and poor user experience.
[0004] The present application provides a method for displaying bullet screens in a live broadcast, which is applied to a terminal device and includes:
[0005] In response to an instruction that the first anchor and the second anchor are successfully connected to each other, a split-screen mode is turned on, wherein the split-screen mode displays a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor;
[0006] Receiving first barrage information associated with the first anchor, and receiving second barrage information associated with the second anchor;
[0007] The first barrage information is displayed in the first area, and the second barrage information is displayed in the second area.
[0008] Optionally, the receiving first barrage information associated with the first anchor, and the receiving second barrage information associated with the second anchor includes:
[0009] First barrage information associated with the first anchor is received through a first communication link, and second barrage information associated with the second anchor is received through a second communication link.
[0010] Optionally, the method further comprises:
[0011] receiving a first live video stream associated with the first anchor via the first communication link, and receiving a second live video stream associated with the second anchor via the second communication link;
[0012] The displaying of the first bullet screen information in the first area includes:
[0013] Decoding the first live video stream and the first bullet screen information through a first video player to obtain a decoded first live screen and a first bullet screen;
[0014] Play the first live broadcast picture in the first area through the first video player, and display the first bullet screen in a floating manner on the upper layer of the first video player;
[0015] The displaying of the second bullet screen information in the second area includes:
[0016] Decoding the second live video stream and the second bullet screen information by a second video player to obtain a decoded second live screen and a second bullet screen;
[0017] The second live broadcast screen is played in the second area through the second video player, and the second bullet screen is displayed in a floating manner on the upper layer of the second video player.
[0018] Optionally, the method further comprises:
[0019] In response to an instruction to end the joint broadcast between the first host and the second host, exit the split-screen mode;
[0020] Decoding the first live video stream and the first bullet screen information through the first video player to obtain a decoded third live screen and a third bullet screen;
[0021] The third live broadcast picture is played in full screen in the screen through the first video player, and the third bullet screen is displayed floating on the upper layer of the first video player.
[0022] Optionally, the method further comprises:
[0023] When detecting that a user enters the play page of the live broadcast room, establishing the first communication link with the server;
[0024] Receiving, via the first communication link, a first live video stream and first bullet screen information associated with the first anchor sent by the server;
[0025] Decoding the first live video stream and the first bullet screen information through the first video player to obtain a decoded fourth live screen and a fourth bullet screen;
[0026] The fourth live broadcast picture is played in full screen in the screen through the first video player, and the fourth bullet screen is displayed floating on the upper layer of the first video player.
[0027] Optionally, the first communication link and the second communication link are both Socket long links.
[0028] The present application also provides a method for sending barrage in live broadcast and microphone connection, which is applied to a server and includes:
[0029] receiving a microphone connection instruction initiated by the first anchor through the first anchor terminal, wherein the microphone connection instruction is used to connect the first anchor with the second anchor in the live broadcast room;
[0030] Sending the microphone connection instruction to a second anchor terminal corresponding to the second anchor;
[0031] receiving microphone connection status information fed back by the second anchor through the second anchor terminal;
[0032] When the microphone connection status information is a microphone connection success instruction, establishing a first communication link with the terminal device;
[0033] First barrage information associated with the first anchor is sent to the terminal device through a second communication link pre-established with the terminal device, and second barrage information associated with the second anchor is sent to the terminal device through the first communication link established with the terminal device.
[0034] Optionally, the method further comprises:
[0035] receiving a live broadcast end instruction sent by the first anchor through the first anchor terminal, or receiving a live broadcast end instruction sent by the second anchor through the second anchor terminal;
[0036] The first communication link established with the terminal device is disconnected.
[0037] The present application also provides a device for displaying bullet screens in a live broadcast, which is characterized by comprising:
[0038] A response module, configured to respond to an instruction that the first anchor and the second anchor are successfully connected to each other, and start a split-screen mode, wherein the split-screen mode displays a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor;
[0039] A receiving module, configured to receive first barrage information associated with the first host, and receive second barrage information associated with the second host;
[0040] A display module is used to display the first bullet screen information in the first area and the second bullet screen information in the second area.
[0041] The present application also provides a device for sending barrage in live broadcast and microphone connection, including:
[0042] A first receiving module is used to receive a microphone connection instruction initiated by the first anchor through the first anchor terminal, where the microphone connection instruction is used to connect the first anchor with the second anchor in the live broadcast room;
[0043] A first sending module, used for sending the microphone connection instruction to a second anchor terminal corresponding to the second anchor;
[0044] A second receiving module is used to receive the microphone connection status information fed back by the second anchor through the second anchor terminal;
[0045] An establishing module, configured to establish a first communication link with the terminal device when the microphone connection status information is a microphone connection success instruction;
[0046] The second sending module is used to send the first barrage information associated with the first anchor to the terminal device through the second communication link pre-established with the terminal device, and to send the second barrage information associated with the second anchor to the terminal device through the first communication link established with the terminal device.
[0047] The present application also provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.
[0048] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method are implemented.
[0049] In this embodiment, after the first anchor and the second anchor are connected to the microphone, the terminal device will receive the first barrage information associated with the first anchor sent by the server, and receive the second barrage information associated with the second anchor sent by the server; thereafter, after obtaining the barrage information associated with the two anchors, the terminal device will display the first barrage information in the first area of the screen, and display the second barrage information in the second area of the screen, thereby realizing the simultaneous display of the barrages of the first anchor A and the second anchor B in the screen, so that the audiences between the two anchors can interact, thereby improving the interactivity between the audiences and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1This is a schematic diagram of the environment of the method for displaying and sending barrage in live broadcast and microphone connection according to an embodiment of the present application;
[0051] Figure 2 This is a flowchart of an embodiment of the method for displaying bullet screens in live broadcast and microphone connection described in this application;
[0052] Figure 3 A schematic diagram of a detailed flow chart of the steps for displaying the first bullet screen information in the first area in one embodiment of the present application;
[0053] Figure 4 A schematic diagram of a detailed flow chart of the steps of displaying the second bullet screen information in the second area in one embodiment of the present application;
[0054] Figure 5 This is a flowchart of another embodiment of the method for displaying bullet screens in live broadcast and microphone connection described in this application;
[0055] Figure 6 This is a flowchart of another embodiment of the method for displaying bullet screens in live broadcast and microphone connection described in this application;
[0056] Figure 7 This is a flowchart of an embodiment of the method for sending barrage in live broadcast and microphone connection described in this application;
[0057] Figure 8 This is a flowchart of another embodiment of the method for sending barrage in live broadcast and microphone connection described in this application;
[0058] Fig. 9 A program module diagram of an embodiment of the device for displaying bullet screens in live broadcast and microphone connection described in the present application;
[0059] Fig.10 A program module diagram of an embodiment of a device for sending barrage in live broadcast and microphone connection described in this application;
[0060] Fig.11 A schematic diagram of the hardware structure of a computer device for executing a method for displaying and sending barrage during live broadcast and microphone connection provided in an embodiment of the present application. DETAILED DESCRIPTION
[0061] The advantages of the present application are further described below in conjunction with the accompanying drawings and specific embodiments.
[0062] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0063] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0064] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".
[0065] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.
[0066] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present application is shown, and the application scenario includes: a live broadcast server 100, an anchor terminal 200, and an audience terminal 300. The live broadcast server 100, the anchor terminal 200, and the audience terminal 300 are located in a wireless network or a wired network, and the live broadcast server 100 can exchange data with the anchor terminal 200 and the audience terminal 300. In some embodiments, the number of anchor terminals 200 ( Figure 1 Only one is shown) and the number of viewer terminals 300 ( Figure 1 Only one is shown in the figure) and there is no limitation. The audience terminal 300 and the anchor terminal 200 can use the live broadcast server 100 as a transmission medium and implement data exchange with each other through the Internet.
[0067] In the embodiment of the present application, the live broadcast server 100 may be a separate server or a server cluster, a local server or a cloud server, and the specific server type may not be limited in the embodiment of the present application. The anchor terminal 200 and the audience terminal 300 may be a mobile phone, a smart phone, a laptop computer, a desktop computer, a tablet computer, a personal digital assistant (PDA), a media player, a smart TV, a wearable electronic device, etc., and the specific terminal device type may not be limited in the embodiment of the present application.
[0068] In this embodiment, a live broadcast client may be installed in the anchor terminal 200, and the live broadcast client is used to enable the anchor to broadcast live video. The live broadcast client may be a computer application (Application, APP) installed on the anchor terminal 200, or a Web client, which may refer to an application developed based on a Web architecture.
[0069] In this embodiment, a viewer client may be installed in the viewer terminal 300, and the viewer client is used to enable the viewer to receive and display the live content. The viewer client may be a computer application (Application, APP) installed on the viewer terminal 300, or a Web client, which may refer to an application developed based on a Web architecture.
[0070] See also Figure 2 , which is a flow chart of a method for displaying bullet screens in a live broadcast with microphones in one embodiment of the present application. Applied to a terminal device, the terminal device can be a viewer terminal or a host terminal. It can be understood that the flowchart in the embodiment of the present method is not used to limit the order of executing the steps. As can be seen from the figure, the method for displaying bullet screens in a live broadcast with microphones provided in the present embodiment includes:
[0071] Step S20, in response to the successful link-up instruction between the first anchor and the second anchor, start the split-screen mode, wherein the split-screen mode displays a first area and a second area on the screen, the first area is associated with the first anchor, and the second area is associated with the second anchor.
[0072] Specifically, the microphone connection success instruction is an instruction for indicating that the first host and the second host have successfully connected to the microphone.
[0073] The first area and the second area constitute the display area of the screen. The sizes of the first area and the second area can be the same or different, and the sizes of the first area and the second area can also be adjusted by the user during the specific display process.
[0074] In this embodiment, the split screen mode may be a top-bottom split screen mode or a left-right split screen mode, which is not limited in this embodiment.
[0075] As an example, when the first anchor A is broadcasting live in the live broadcast room, he can interact with the anchors broadcasting live in other live broadcast rooms through a live broadcast. For example, the first anchor A can initiate a live broadcast request to the second anchor B so that the first anchor A can PK with the second anchor B through a live broadcast. When the first anchor A triggers a live broadcast request to connect with the second anchor through the first anchor terminal, the first anchor terminal will generate a live broadcast instruction according to the live broadcast request triggered by the first anchor A, and send the live broadcast instruction to the server through the communication link established between the first anchor terminal and the server. Among them, the live broadcast instruction includes information about the second anchor terminal to be connected to the microphone. After receiving the live broadcast instruction, the server will send the live broadcast instruction to the second anchor terminal, so that the second anchor B corresponding to the second anchor terminal can decide whether to receive the live broadcast request of the first anchor. The second anchor terminal can generate live broadcast status information to the server according to the decision of the second anchor B, wherein the live broadcast status information can be for agreeing to connect to the microphone or for not agreeing to connect to the microphone. When the server receives the microphone connection status information from the second anchor terminal, it can judge the microphone connection status information to determine whether the microphone connection status information agrees to the microphone connection or disagrees with the microphone connection instruction. When the server determines that the microphone connection status information agrees to the microphone connection, the server can send the microphone connection success instruction to the audience terminals corresponding to all the audiences currently in the first anchor A, as well as the first anchor terminal and the second anchor terminal. In this way, each audience in the anchor room of the first anchor A can receive the microphone connection success instruction through their respective audience terminals. Similarly, each audience in the anchor room of the first anchor B can receive the microphone connection success instruction through their respective audience terminals. The first anchor A and the second anchor B can also receive the microphone connection success instruction through their respective anchor terminals. After each terminal device (including the anchor terminal and the audience terminal) receives the microphone connection success instruction, it can respond to the microphone connection success instruction, thereby turning on the split-screen mode.
[0076] In one embodiment, when the server sends a successful microphone connection instruction to a terminal device, the server may send the successful microphone connection instruction to all terminal devices by broadcasting. In another embodiment, when the terminal device sends a successful microphone connection instruction, the server may also send the successful microphone connection instruction to all terminal devices by message subscription. Specifically, after the server obtains the successful microphone connection instruction, the successful microphone connection instruction may be sent to the message middleware, and each terminal device obtains the successful microphone connection instruction by subscribing to the successful microphone connection instruction message in the message middleware.
[0077] In an exemplary implementation, when receiving the microphone connection success instruction, the terminal device may receive the microphone connection success instruction sent by the server through the third communication link.
[0078] Specifically, each terminal device may establish a third communication link with the server in advance, and the third communication link is used to monitor whether there is a successful microphone connection instruction in the server. When the successful microphone connection instruction is detected in the server, the successful microphone connection instruction sent by the server may be received through the third communication link.
[0079] The third communication link may be a long Socket link. A long Socket link is a link that maintains a socket connection between a client and a server for a long time without disconnection. The third communication link may also be a long WebSocket link.
[0080] Step S21, receiving first barrage information associated with the first anchor, and receiving second barrage information associated with the second anchor.
[0081] Specifically, when the first anchor A and the second anchor B are successfully connected to the microphone, the server will send the first barrage information associated with the first anchor and the second barrage information associated with the second anchor to the terminal device, so that the terminal device can receive the first barrage information and the second barrage information.
[0082] In an exemplary embodiment, the receiving first barrage information associated with the first anchor and the receiving second barrage information associated with the second anchor include:
[0083] First barrage information associated with the first anchor is received through a first communication link, and second barrage information associated with the second anchor is received through a second communication link.
[0084] Specifically, the first communication link is a channel established between the terminal device and the server for transmitting a first live video stream and / or first bullet screen information associated with the first anchor A. The second communication link is a channel established between the terminal device and the server for transmitting a second live video stream and / or second bullet screen information associated with the second anchor B.
[0085] In this embodiment, the first barrage information and the second barrage information may include ordinary barrage (comment information) sent by viewers in the live broadcast room, and reward gift barrage (reward gifts) sent by viewers in the live broadcast room.
[0086] The first communication link and the second communication link may be a Socket long link or a WebSocket long link.
[0087] When the server sends the first barrage information and the second barrage information to the terminal device, in order to facilitate the terminal device to distinguish the first barrage information and the second barrage information, the server can send the first barrage information through a first communication link established with the terminal device, and send the second barrage information through a second communication link established with the terminal device.
[0088] It is understandable that the server may also send the first barrage information and the second barrage information to the terminal device through only one communication link.
[0089] In an exemplary embodiment, when the server sends the first bullet-screen information to the terminal device through the first communication link, it may also send the first live video stream associated with the first anchor to the terminal device through the first communication link, so that the terminal device can receive the first live video stream associated with the first anchor through the first communication link. Similarly, when the server sends the second bullet-screen information to the terminal device through the second communication link, it may also send the second live video stream associated with the second anchor to the terminal device through the second communication link, so that the terminal device can receive the second live video stream associated with the second anchor through the second communication link.
[0090] Step S22, displaying the first bullet screen information in the first area, and displaying the second bullet screen information in the second area.
[0091] Specifically, after obtaining the first barrage information and the second barrage information, the terminal device can display the first barrage information in the first area of the screen and display the second barrage information in the second area of the screen.
[0092] In an exemplary embodiment, when the terminal device also receives the first live video stream through the first communication link, referring to Figure 3 , the displaying of the first barrage information in the first area includes: step S30, decoding the first live video stream and the first barrage information through the first video player to obtain the decoded first live picture and the first barrage; step S31, playing the first live picture in the first area through the first video player, and displaying the first barrage in a floating manner on the upper layer of the first video player.
[0093] Specifically, the first video player is a video player that decodes and plays the live video stream and barrage information in the current live broadcast room before the split-screen mode is turned on.
[0094] In this embodiment, for the first bullet screen displayed floating on the first player, the user can control the display of the first bullet screen through the preset bullet screen on / off button. For example, if the user turns off the bullet screen play button through the button, the first bullet screen will no longer be displayed when the first live screen is played. Only when the bullet screen play button is turned on, the first bullet screen will be displayed when the first live screen is played.
[0095] In another embodiment, when displaying the barrage, the first barrage may not be displayed in a floating manner, but the first live screen may be played by using a partial area in the first area, and the first barrage may be displayed by using the remaining partial area in the first area.
[0096] In an exemplary embodiment, when the terminal device also receives the second live video stream through the second communication link, refer to Figure 4 , the displaying of the second barrage information in the second area includes: step S40, decoding the second live video stream and the second barrage information through the second video player to obtain the decoded second live picture and the second barrage; step S41, playing the second live picture in the second area through the second video player, and displaying the second barrage in a floating manner on the upper layer of the second video player.
[0097] Specifically, the second video player is a video player newly created after the split-screen mode is turned on, and is used to decode and play the live video stream and barrage information of the second anchor B.
[0098] In this embodiment, for the second bullet screen displayed floating on the second player, the user can control the display of the second bullet screen through the preset bullet screen on / off button. For example, if the user turns off the bullet screen play button through the button, the second bullet screen will no longer be displayed when the second live screen is played. Only when the bullet screen play button is turned on, the second bullet screen will be displayed when the second live screen is played.
[0099] In another embodiment, when displaying the barrage, the second barrage may not be displayed in a floating manner, but the second live screen may be played by using a partial area in the second area, and the second barrage may be displayed by using the remaining partial area in the second area.
[0100] In this embodiment, after the first anchor and the second anchor are connected to the microphone, the terminal device will receive the first barrage information associated with the first anchor sent by the server, and receive the second barrage information associated with the second anchor sent by the server; thereafter, after obtaining the barrage information associated with the two anchors, the terminal device will display the first barrage information in the first area of the screen, and display the second barrage information in the second area of the screen, thereby realizing the simultaneous display of the barrages of the first anchor A and the second anchor B in the screen, so that the audiences between the two anchors can interact, thereby improving the interactivity between the audiences and enhancing the user experience.
[0101] In an exemplary embodiment, see Figure 5 , the method further comprises:
[0102] Step S50, in response to the instruction of ending the joint broadcast between the first anchor and the second anchor, exiting the split-screen mode.
[0103] Specifically, the microphone connection end instruction is used to represent an instruction for the first anchor A and the second anchor B to end the microphone connection operation in the live broadcast room.
[0104] In this embodiment, when the first anchor A and the second anchor B do not want to continue the live broadcast, for example, the live broadcast PK between the first anchor A and the second anchor B ends, at this time, the first anchor A or the second anchor B can trigger the live broadcast end request through the anchor terminal (the first anchor terminal or the second anchor terminal), and the anchor terminal will generate live broadcast status information according to the live broadcast end request triggered by the first anchor A or the second anchor B, and send the live broadcast status information to the server. After receiving the live broadcast status information, the server will judge the live broadcast status information to determine whether the live broadcast status information is a live broadcast end instruction. When it is determined to be a live broadcast end instruction, the server will send the live broadcast end instruction to each audience terminal through the communication link established with each audience terminal corresponding to the first anchor A and the second anchor B. At the same time, the server can also send the live broadcast end instruction to the anchor terminals corresponding to the first anchor A and the second anchor B. In this way, each terminal device can receive the live broadcast end instruction sent by the server.
[0105] It should be noted that the way in which the server sends the microphone connection end instruction is the same as the way in which the server sends the microphone connection success instruction, which will not be repeated in this embodiment.
[0106] After receiving the microphone connection end instruction sent by the server, the terminal device will respond to the microphone connection end instruction, thereby exiting the current split-screen mode and returning to the full-screen mode.
[0107] Step S51: decode the first live video stream and the first barrage information through the first video player to obtain a decoded third live screen and a third barrage.
[0108] Specifically, after exiting the split-screen mode, the first live video stream and the first barrage information will continue to be decoded through the first video player to obtain the decoded third live screen and the third barrage.
[0109] Step S52: Play the third live broadcast picture in full screen on the screen through the first video player, and display the third bullet screen in a floating manner on the upper layer of the first video player.
[0110] Specifically, after exiting the split-screen mode, the first video player will play the third live broadcast picture in full screen, and only display the third barrage in a floating manner on the upper layer of the first video player, and will no longer display the barrage associated with the second anchor B.
[0111] In an exemplary embodiment, see Figure 6 , the method further comprises:
[0112] Step S60, when it is detected that the user enters the play page of the live broadcast room, the first communication link is established with the server.
[0113] Step S61: receiving a first live video stream and first bullet screen information associated with the first anchor and sent by the server through the first communication link.
[0114] Specifically, when it is detected that a user enters the playback page of the live broadcast room to watch the live video of the first anchor A, the terminal device will establish a first communication link with the server, so that the terminal device can receive the first live video stream and first barrage information associated with the first anchor A from the server through the first communication link.
[0115] Step S62: decode the first live video stream and the first barrage information through the first video player to obtain a decoded fourth live screen and a fourth barrage.
[0116] Specifically, when a user enters the live broadcast room to watch the live video of the first anchor A, the first live video stream and the first barrage information will be decoded through the first video player to obtain the decoded fourth live broadcast screen and the fourth barrage.
[0117] Step S63, playing the fourth live broadcast picture in full screen on the screen through the first video player, and displaying the fourth bullet screen in a floating manner on the upper layer of the first video player.
[0118] Specifically, when the user enters the live broadcast room to watch the live video of the first anchor A, the first video player will play the fourth live broadcast screen in full screen, and display the fourth bullet screen in a floating manner on the upper layer of the first video player.
[0119] In another embodiment, the first video player may play the fourth live picture in a partial area of the screen and display the fourth bullet screen in the remaining area of the screen.
[0120] See also Figure 7 , which is a flow chart of a method for sending bullet screens in a live broadcast and microphone connection in one embodiment of the present application. Applied to the live broadcast server 100, it can be understood that the flowchart in the embodiment of the method is not used to limit the order of executing the steps. As can be seen from the figure, the method for sending bullet screens in a live broadcast and microphone connection provided in the present embodiment includes:
[0121] Step S70, receiving a microphone connection instruction initiated by the first anchor through the first anchor terminal, wherein the microphone connection instruction is used to connect the first anchor and the second anchor in the live broadcast room.
[0122] Step S71, sending the microphone connection instruction to the second anchor terminal corresponding to the second anchor;
[0123] Step S72, receiving microphone connection status information fed back by the second anchor through the second anchor terminal;
[0124] Step S73: when the microphone connection status information is a microphone connection success instruction, establishing a first communication link with the terminal device;
[0125] Step S74, sending first barrage information associated with the first anchor to the terminal device through a second communication link pre-established with the terminal device, and sending second barrage information associated with the second anchor to the terminal device through the first communication link established with the terminal device.
[0126] Specifically, when the first anchor A is broadcasting live in the live broadcast room, he can interact with the anchors who are broadcasting live in other live broadcast rooms through the live broadcast. For example, the first anchor A can initiate a live broadcast request to the second anchor B so that the first anchor A can PK with the second anchor B through the live broadcast.
[0127] In this embodiment, when the first anchor A triggers a connection request to connect with the second anchor through the first anchor terminal, the first anchor terminal generates a connection instruction according to the connection request triggered by the first anchor A, and sends the connection instruction to the server through the communication link established between the first anchor terminal and the server. The connection instruction includes information about the second anchor terminal to be connected.
[0128] After receiving the microphone connection instruction, the server will send the microphone connection instruction to the second anchor terminal, so that the second anchor B corresponding to the second anchor terminal can decide whether to receive the microphone connection request of the first anchor. The second anchor terminal can generate microphone connection status information to the server according to the decision of the second anchor B, wherein the microphone connection status information can be for agreeing to microphone connection or for disagreeing to microphone connection. When the server receives the microphone connection status information from the second anchor terminal, it can judge the microphone connection status information to determine whether the microphone connection status information agrees to microphone connection or disagrees to microphone connection instruction. When the server determines that the microphone connection status information agrees to microphone connection, the server can send the microphone connection success instruction to the audience terminals corresponding to all the audiences currently in the first anchor A, as well as the first anchor terminal and the second anchor terminal. In this way, each audience in the anchor room of the first anchor A can receive the microphone connection success instruction through their respective audience terminals. Similarly, each audience in the anchor room of the first anchor B can receive the microphone connection success instruction through their respective audience terminals. The first anchor A and the second anchor B can also receive the microphone connection success instruction through their respective anchor terminals.
[0129] In this embodiment, when the microphone connection status information is determined to be a microphone connection success instruction, the server will also establish a new communication link with each terminal device so that the live video and / or barrage information of the corresponding anchor (first anchor A or second anchor B) can be transmitted through the communication link.
[0130] It should be noted that the first communication link and the second communication link in this embodiment respectively correspond to the second communication link and the first communication link in the above-mentioned method for displaying barrage in live broadcast and microphone connection.
[0131] In an exemplary embodiment, see Figure 8 The method further includes: step S80, receiving a live broadcast end instruction sent by the first anchor through the first anchor terminal, or receiving a live broadcast end instruction sent by the second anchor through the second anchor terminal; step S81, disconnecting the first communication link established with the terminal device.
[0132] Specifically, when the first anchor A and the second anchor B end the live broadcast, the server will disconnect the first communication link established with the terminal device for transmitting the second live video stream and the second barrage information associated with the second anchor B, so that the terminal device can stop receiving the second live video stream and / or the second barrage information associated with the second anchor B and resume normal playback mode.
[0133] See also Fig. 9 As shown, it is a program module diagram of an embodiment of a barrage display device 90 in live broadcast and microphone connection of the present application.
[0134] In this embodiment, the live broadcast and microphone barrage display device 90 includes a series of computer program instructions stored in the memory. When the computer program instructions are executed by the processor, the live broadcast and microphone barrage display function of each embodiment of the present application can be implemented. In some embodiments, based on the specific operations implemented by each part of the computer program instructions, the live broadcast and microphone barrage display device 90 can be divided into one or more modules. The specific modules that can be divided are as follows:
[0135] A response module 91 is used to respond to the instruction of successful connection between the first anchor and the second anchor, and start the split screen mode, wherein the split screen mode displays a first area and a second area on the screen, the first area is associated with the first anchor, and the second area is associated with the second anchor;
[0136] A receiving module 92, configured to receive first barrage information associated with the first anchor, and receive second barrage information associated with the second anchor;
[0137] The display module 93 is used to display the first bullet screen information in the first area and the second bullet screen information in the second area.
[0138] In an exemplary embodiment, the receiving module 92 is further used to receive first barrage information associated with the first anchor through a first communication link, and to receive second barrage information associated with the second anchor through a second communication link.
[0139] In an exemplary embodiment, the receiving module 92 is further configured to receive a first live video stream associated with the first anchor via the first communication link, and to receive a second live video stream associated with the second anchor via the second communication link.
[0140] The display module 93 is also used to decode the first live video stream and the first barrage information through the first video player to obtain the decoded first live picture and the first barrage; play the first live picture in the first area through the first video player, and display the first barrage in a floating manner on the upper layer of the first video player.
[0141] The display module 93 is also used to decode the second live video stream and the second barrage information through a second video player to obtain a decoded second live picture and second barrage; play the second live picture in the second area through the second video player, and display the second barrage in a floating manner on the upper layer of the second video player.
[0142] In an exemplary embodiment, the response module 91 is further configured to exit the split-screen mode in response to an instruction to end the live broadcast between the first host and the second host.
[0143] The display module 93 is also used to decode the first live video stream and the first barrage information through the first video player to obtain a decoded third live picture and a third barrage; play the third live picture in full screen on the screen through the first video player, and display the third barrage in a floating manner on the upper layer of the first video player.
[0144] In an exemplary embodiment, the barrage display device 90 in the live broadcast and microphone connection also includes: a establishing module and a receiving module.
[0145] The establishing module is further configured to establish the first communication link with the server when detecting that a user enters the play page of the live broadcast room;
[0146] The receiving module is used to receive the first live video stream and first bullet screen information associated with the first anchor sent by the server through the first communication link;
[0147] The display module 93 is also used to decode the first live video stream and the first barrage information through the first video player to obtain a decoded fourth live picture and a fourth barrage; play the fourth live picture in full screen on the screen through the first video player, and display the fourth barrage in a floating manner on the upper layer of the first video player.
[0148] In an exemplary implementation, the first communication link and the second communication link are both long Socket links.
[0149] In this embodiment, after the first anchor and the second anchor are connected to the microphone, the terminal device will receive the first barrage information associated with the first anchor sent by the server, and receive the second barrage information associated with the second anchor sent by the server; thereafter, after obtaining the barrage information associated with the two anchors, the terminal device will display the first barrage information in the first area of the screen, and display the second barrage information in the second area of the screen, thereby realizing the simultaneous display of the barrages of the first anchor A and the second anchor B in the screen, so that the audiences between the two anchors can interact, thereby improving the interactivity between the audiences and enhancing the user experience.
[0150] See also Fig.10 As shown, it is a program module diagram of an embodiment of a barrage sending device 100 in live broadcast and microphone connection of the present application.
[0151] In this embodiment, the live broadcast and microphone barrage sending device 100 includes a series of computer program instructions stored in the memory. When the computer program instructions are executed by the processor, the video file playback function of each embodiment of the present application can be implemented. In some embodiments, based on the specific operations implemented by each part of the computer program instructions, the live broadcast and microphone barrage sending device 100 can be divided into one or more modules. The specific modules that can be divided are as follows:
[0152] The first receiving module 101 is used to receive a microphone connection instruction initiated by the first anchor through the first anchor terminal, where the microphone connection instruction is used to connect the first anchor with the second anchor in the live broadcast room;
[0153] A first sending module 102, configured to send the microphone connection instruction to a second anchor terminal corresponding to the second anchor;
[0154] The second receiving module 103 is used to receive the microphone connection status information fed back by the second anchor through the second anchor terminal;
[0155] An establishing module 104 is configured to establish a first communication link with a terminal device when the microphone connection status information is a microphone connection success instruction;
[0156] The second sending module 105 is used to send the first barrage information associated with the first anchor to the terminal device through the second communication link pre-established with the terminal device, and to send the second barrage information associated with the second anchor to the terminal device through the first communication link established with the terminal device.
[0157] In an exemplary embodiment, the barrage sending device 100 in live broadcast and microphone connection further includes a third receiving module and a disconnecting module.
[0158] The third receiving module is used to receive a microphone connection end instruction sent by the first anchor through the first anchor terminal, or receive a microphone connection end instruction sent by the second anchor through the second anchor terminal;
[0159] The disconnection module is used to disconnect the first communication link established with the terminal device.
[0160] Fig.11The schematic diagram of the hardware architecture of a computer device 11 suitable for implementing the method of displaying and sending barrage in live broadcast and microphone connection according to an embodiment of the present application is shown schematically. In this embodiment, the computer device 11 is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. For example, it can be a tablet computer, a laptop computer, a desktop computer, a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig.11 As shown, the computer device 11 includes at least but is not limited to: a memory 120, a processor 121, and a network interface 122 that can communicate with each other through a system bus. Among them:
[0161] The memory 120 includes at least one type of computer-readable storage medium, which may be volatile or non-volatile. Specifically, the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 120 may be an internal storage module of the computer device 11, such as a hard disk or memory of the computer device 11. In other embodiments, the memory 120 may also be an external storage device of the computer device 11, such as a plug-in hard disk equipped on the computer device 11, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card, etc. Of course, the memory 120 may also include both the internal storage module of the computer device 11 and its external storage device. In this embodiment, the memory 120 is generally used to store the operating system and various application software installed on the computer device 11, such as the program code of the bullet screen display and sending method in the live broadcast connection, etc. In addition, the memory 120 can also be used to temporarily store various data that have been output or will be output.
[0162] In some embodiments, the processor 121 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other live broadcast or microphone barrage display or transmission chip. The processor 121 is generally used to control the overall operation of the computer device 11, such as performing control and processing related to data interaction or communication with the computer device 11. In this embodiment, the processor 121 is used to run the program code stored in the memory 120 or process data.
[0163] The network interface 122 may include a wireless network interface or a wired network interface, and the network interface 122 is generally used to establish a communication link between the computer device 11 and other computer devices. For example, the network interface 122 is used to connect the computer device 11 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 11 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.
[0164] It should be pointed out that Fig.11 Only a computer device having components 120 - 122 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.
[0165] In this embodiment, the method for displaying and sending barrage in live broadcast and microphone connection stored in the memory 120 can be divided into one or more program modules and executed by one or more processors (processor 121 in this embodiment) to complete the present application.
[0166] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for displaying and sending barrage in live broadcast and microphone connection in the embodiment are implemented.
[0167] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card, etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both an internal storage unit of a computer device and an external storage device thereof. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on a computer device, such as the program code of the bullet screen display and sending method in the live broadcast and microphone connection in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.
[0168] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on at least two network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiment scheme of the present application. Those of ordinary skill in the art may understand and implement it without creative labor.
[0169] Through the description of the above implementation methods, a person of ordinary skill in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.
[0170] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for displaying bullet screen in live broadcast and microphone connection, applied to a terminal device, characterized in that: include: In response to an instruction that the first anchor and the second anchor are successfully connected to each other, a split-screen mode is turned on, wherein the split-screen mode displays a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor; Receiving first barrage information associated with the first anchor, and receiving second barrage information associated with the second anchor; Displaying first bullet chat information in the first area, and displaying second bullet chat information in the second area; The receiving of first barrage information associated with the first anchor and the receiving of second barrage information associated with the second anchor include: Receiving first barrage information associated with the first anchor through a first communication link, and receiving second barrage information associated with the second anchor through a second communication link; wherein a first live video stream associated with the first anchor is received through the first communication link, and a second live video stream associated with the second anchor is received through the second communication link; The displaying of the first bullet screen information in the first area includes: Decoding the first live video stream and the first bullet screen information through a first video player to obtain a decoded first live screen and a first bullet screen; Play the first live broadcast picture in the first area through the first video player, and display the first bullet screen in a floating manner on the upper layer of the first video player; The displaying of the second bullet screen information in the second area includes: Decoding the second live video stream and the second bullet screen information by a second video player to obtain a decoded second live screen and a second bullet screen; The second live broadcast screen is played in the second area through the second video player, and the second bullet screen is displayed in a floating manner on the upper layer of the second video player.
2. The method for displaying bullet screens in live broadcasting according to claim 1, characterized in that: The method further comprises: In response to an instruction to end the joint broadcast between the first host and the second host, exit the split-screen mode; Decoding the first live video stream and the first bullet screen information through the first video player to obtain a decoded third live screen and a third bullet screen; The third live broadcast picture is played in full screen in the screen through the first video player, and the third bullet screen is displayed floating on the upper layer of the first video player.
3. The method for displaying bullet screens in live broadcast and microphone connection according to claim 1, characterized in that: The method further comprises: When detecting that the user enters the play page of the live broadcast room, establishing the first communication link with the server; Receiving, via the first communication link, a first live video stream and first bullet screen information associated with the first anchor sent by the server; Decoding the first live video stream and the first bullet screen information through the first video player to obtain a decoded fourth live screen and a fourth bullet screen; The fourth live broadcast picture is played in full screen in the screen through the first video player, and the fourth bullet screen is displayed floating on the upper layer of the first video player.
4. The method for displaying bullet screens in live broadcast and microphone connection according to any one of claims 2 to 3, characterized in that: The first communication link and the second communication link are both Socket long links.
5. A method for sending barrage in live broadcast, applied in a server, characterized in that: include: receiving a microphone connection instruction initiated by the first anchor through the first anchor terminal, wherein the microphone connection instruction is used to connect the first anchor with the second anchor in the live broadcast room; Sending the microphone connection instruction to a second anchor terminal corresponding to the second anchor; receiving microphone connection status information fed back by the second anchor through the second anchor terminal; When the microphone connection status information is a microphone connection success instruction, establishing a first communication link with the terminal device; Sending first barrage information associated with the first anchor to the terminal device through a second communication link pre-established with the terminal device, and sending second barrage information associated with the second anchor to the terminal device through the first communication link established with the terminal device; The terminal device is used to: in response to a successful link-up instruction between the first anchor and the second anchor, start a split-screen mode, wherein the split-screen mode is to display a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor; receive first bullet screen information associated with the first anchor through a second communication link, and receive second bullet screen information associated with the second anchor through the first communication link; Displaying first bullet chat information in the first area, and displaying second bullet chat information in the second area; receiving a first live video stream associated with the first anchor via the second communication link, and receiving a second live video stream associated with the second anchor via the first communication link; The displaying of the first bullet screen information in the first area includes: Decoding the first live video stream and the first bullet screen information through a first video player to obtain a decoded first live screen and a first bullet screen; Play the first live broadcast picture in the first area through the first video player, and display the first bullet screen in a floating manner on the upper layer of the first video player; The displaying of the second bullet screen information in the second area includes: Decoding the second live video stream and the second bullet screen information by a second video player to obtain a decoded second live screen and a second bullet screen; The second live broadcast screen is played in the second area through the second video player, and the second bullet screen is displayed in a floating manner on the upper layer of the second video player.
6. The method for sending barrage in live broadcast and microphone connection according to claim 5, characterized in that: The method further comprises: receiving a live broadcast end instruction sent by the first anchor through the first anchor terminal, or receiving a live broadcast end instruction sent by the second anchor through the second anchor terminal; The first communication link established with the terminal device is disconnected.
7. A device for displaying bullet screens in live broadcast and microphone connection, applied to a terminal device, characterized in that: include: A response module, configured to respond to an instruction that the first anchor and the second anchor are successfully connected to each other, and start a split-screen mode, wherein the split-screen mode displays a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor; A receiving module, configured to receive first barrage information associated with the first host, and receive second barrage information associated with the second host; A display module, used to display the first bullet screen information in the first area, and display the second bullet screen information in the second area; Among them, the receiving module is also used for: Receiving first barrage information associated with the first anchor through a first communication link, and receiving second barrage information associated with the second anchor through a second communication link; receiving a first live video stream associated with the first anchor via the first communication link, and receiving a second live video stream associated with the second anchor via the second communication link; The displaying of the first bullet screen information in the first area includes: Decoding the first live video stream and the first bullet screen information through a first video player to obtain a decoded first live screen and a first bullet screen; Play the first live broadcast picture in the first area through the first video player, and display the first bullet screen in a floating manner on the upper layer of the first video player; The displaying of the second bullet screen information in the second area includes: Decoding the second live video stream and the second bullet screen information by a second video player to obtain a decoded second live screen and a second bullet screen; The second live broadcast screen is played in the second area through the second video player, and the second bullet screen is displayed in a floating manner on the upper layer of the second video player.
8. A device for sending barrage in live broadcast and microphone connection, applied to a server, characterized in that: include: A first receiving module is used to receive a microphone connection instruction initiated by the first anchor through the first anchor terminal, where the microphone connection instruction is used to connect the first anchor with the second anchor in the live broadcast room; A first sending module, used for sending the microphone connection instruction to a second anchor terminal corresponding to the second anchor; A second receiving module is used to receive the microphone connection status information fed back by the second anchor through the second anchor terminal; An establishing module, configured to establish a first communication link with the terminal device when the microphone connection status information is a microphone connection success instruction; A second sending module, configured to send first barrage information associated with the first anchor to the terminal device through a second communication link pre-established with the terminal device, and send second barrage information associated with the second anchor to the terminal device through the first communication link established with the terminal device; The terminal device is used to: in response to a successful link-up instruction between the first anchor and the second anchor, start a split-screen mode, wherein the split-screen mode is to display a first area and a second area on the screen, wherein the first area is associated with the first anchor, and the second area is associated with the second anchor; receive first bullet screen information associated with the first anchor through a second communication link, and receive second bullet screen information associated with the second anchor through the first communication link; Displaying first bullet chat information in the first area, and displaying second bullet chat information in the second area; receiving a first live video stream associated with the first anchor via the second communication link, and receiving a second live video stream associated with the second anchor via the first communication link; The displaying of the first bullet screen information in the first area includes: Decoding the first live video stream and the first bullet screen information through a first video player to obtain a decoded first live screen and a first bullet screen; Play the first live broadcast picture in the first area through the first video player, and display the first bullet screen in a floating manner on the upper layer of the first video player; The displaying of the second bullet screen information in the second area includes: Decoding the second live video stream and the second bullet screen information by a second video player to obtain a decoded second live screen and a second bullet screen; The second live broadcast screen is played in the second area through the second video player, and the second bullet screen is displayed in a floating manner on the upper layer of the second video player.
9. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Video display method, device and system and electronic equipment
CN110798697A
Live broadcast interactive video processing method and device, electronic device and server
CN111818359A