[0050] The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present invention. Rather, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.
[0051] The terms used in the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and/or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0052] It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to determination".
[0053] For sports events, large-scale game events and other programs, there will usually be anchors who explain the program to improve the interest and comprehensibility of the program. With the rapid rise of the web live broadcast industry, live broadcast of program commentary is becoming increasingly popular. Program commentary live broadcast means that the anchor commentary on a program in its own channel, and at the same time, multiple anchors will comment live on the same program in their respective channels. figure 1 This is a schematic diagram of a live broadcast of a program in the prior art. Take the commentary of anchor A and anchor B for the same game as an example. For the convenience of description, the video stream of the game is referred to as the first video stream, and anchor A commented on the game. The video stream is the second video stream A, and the video stream used by the anchor B to explain the game is the second video stream B.
[0054] The A host client 110 and the B host client 111 are respectively connected to the server 100 through the network, the A viewer client 120 and the B viewer client 121 are respectively connected to the server 100 through the network, and the A host client 110 itself is channel A 101 The channel of the B anchor client itself is B channel 102, the A anchor client 110 obtains the first video stream and the second video stream A captured by the terminal where it is located, and sends the second video stream A to the server, and the server will The first video stream and the second video stream are combined into the target video stream A. The audience client who enters the A channel 101 can obtain the target video stream A to watch. At this time, the video streams watched by the audience in the same channel are all the target video streams. A. In the B channel 102 where the B anchor client 111 is located, the B anchor client 111 sends its second video stream B explaining the first video stream to the server, and the server combines the first video stream and the second video stream B The target video stream B is sent to the viewer client in the B channel 102. If the user of the viewer client 120 who enters the A channel 101 wants to watch the comment of the first video stream by the host where the host client 111 is located, then the user needs to exit the A channel 101 and search for the B channel 102 where the B host client 111 is located Channel number, then enter the B channel 102 to obtain the target video stream B. It can be seen that since each anchor interprets the first video stream in its own channel, if the viewer wants to switch the anchor, the operation will be very cumbersome, and the process from exiting the channel to entering another channel will lead to the first video stream Watching is interrupted. This interrupted time may just cause the audience to miss one of the most important live broadcasts, resulting in a very poor user experience for the audience.
[0055] In order to solve the above-mentioned problems, an embodiment of the present application proposes a live broadcast method. The live broadcast system of the live broadcast method includes an anchor client, a server, and an audience client. Some steps performed by the audience client are as follows figure 2 Shown:
[0056] Step S201: When entering a public channel, obtain a first video stream from the server, and the public channel displays identification information of each anchor client;
[0057] Step S202: When a user instruction triggered by a user for one of the identification information is received, a second video stream corresponding to the identification information is obtained from the server, and the second video stream is a video stream sent by the host client to the server;
[0058] Step S203: Display the first video stream and the second video stream in a public channel.
[0059] The host client and audience client proposed in this application can be installed on terminal equipment, which can have a camera or a network connection function. The terminal equipment can include: smart phones, tablets, laptops, desktop computers, servers It can be understood that this application does not limit the type of terminal where the anchor client is located.
[0060] In some examples, the host client and the viewer client can be installed on the same terminal device; in some examples, the host client and the viewer client are integrated into the same live broadcast application. When the user just watches the live broadcast, the The client where the live broadcast application is located is the audience client; when the client where the user is located sends the video stream to the server, the client where the live broadcast application is located is the host client. It can be understood that when the user performs different operations, the user The identity of sometimes changes from an audience to an anchor, and sometimes from an anchor to an audience.
[0061] The public channel proposed in this application can be a virtual information interaction space provided by the server to users. The server can store the video stream in the public channel space. The host client can also upload the video stream to the corresponding channel space of the server. The viewer enters After the public channel, the server requests the resources of the corresponding channel, including: audio stream, video stream, text, picture and other resources. The server responds to the viewer client request and delivers the resources in the corresponding channel to the viewer client. The returned resources are analyzed and displayed to the user. In some cases, the viewer client can request all or part of the resources in the channel. In some examples, public channels can be identified by ID numbers assigned by the server. In some examples, the public channel may be a channel where the host client is located. It is understood that any channel may be the public channel proposed in this application. In some examples, the public channel of each host client displays the second video stream and the first video stream uploaded to the server by itself, so the video stream displayed on the public channel of each host client may be different; The public channel displays the first video stream and the second video stream obtained according to the user instruction triggered for one of the identification information. Since the second video stream is associated with the host selected by the viewer client, the public channel of each viewer client is displayed The video streams are not necessarily the same.
[0062] In some examples, the first video stream may be a video stream stored on the server, or a video stream sent by other terminals to the server, or a program stream obtained from a broadcast TV network, such as live video streams of the Olympic Games and game competitions. Video streaming etc.
[0063] In some examples, the second video stream may be a video stream used by the host to explain the program stream. For example, an NBA basketball game is being broadcast live on TV, and the host uses a camera to capture the video stream of his commentary on the game. It can be understood that, in this application, the video stream explained by the host to the program stream is used as the content of the second video stream, which is only an optional method of this application, and this application does not limit the content of the second video stream.
[0064] In some examples, the identification information may be the host’s ID number, or the host’s name, or the host’s avatar, or the host’s popularity.
[0065] In some examples, the display mode of the first video stream and the second video stream may be separate display, or picture-in-picture display, or rear left display, or top and bottom display. In some examples, the first video stream and the second video stream are displayed according to the size of the terminal screen where the audience client is located. In some examples, according to the user's editing instruction, the first video stream and the second video stream are displayed as required by the user.
[0066] In some examples, each host client uses its ID number and the public channel ID number to connect the microphone, the host client obtains its own identification information and the second video stream captured by the camera of the terminal where it is located, and the second video stream And the identification information is sent to the server. For example: the ID number of the public channel is 12345, and the ID number of the user where the A host client is located is 23456. After the A host client enters the public channel, it initiates a request to connect to the public channel. After the public channel agrees to the request, the public channel and A The host client establishes a connection through their respective ID numbers. At this time, the second video stream and identification information sent by the host A client to the server will be stored by the server in the space where the public channel is located, which is the storage space corresponding to the ID number 12345. If the host A client does not connect the microphone with its ID number and the public channel ID number, when the host A client sends a video stream to the server, the server will store the video stream in the storage space corresponding to the ID number 23456.
[0067] In some examples, the host client can enter the public channel to connect to the public channel, or the host client can connect to the public channel on its own channel.
[0068] image 3 It is a schematic diagram of a scene of an exemplary live broadcast method of this application, such as image 3 As shown, the server provides a public channel 201, the server stores the first video stream in the public channel 201, the host client 210 enters the public channel 201, obtains the first video stream, and establishes a connection with the public channel 201 through Lianmai, the host client The user of 210 explains the content of the first video stream and captures the video stream with the camera of the terminal device where the host client is located. For the convenience of description, it is referred to as the second video stream A here. The host client 210 obtains the identification information A, and The second video stream A and the identification information A are sent to the server. Similarly, the host client 211 sends the second video stream B and the identification information B to the server, and the audience client enters the public channel to obtain the first video stream. The public channels of the clients 220 and 221 show identification information A and identification information B, and the display effect is as follows Figure 4 As shown in the screen 222, when the user of the audience client 220 selects the identification information B, the second video stream B corresponding to the identification information B is obtained from the server, and the first video stream and the second video stream B are displayed on the audience client On the interface of the public channel of terminal 220, the display effect is as Figure 4 As shown in the screen 223 in, when the user of the audience client 220 wants to watch the commentary video stream of anchor A, he selects identification information A, and the audience client 220 obtains the second video stream A and replaces the second video stream A with the second video stream A. Second video stream B, the final display effect is as Figure 4 As shown in the screen 224 in.
[0069] Similarly, if the user of the viewer client 221 selects the identification information A, the second video stream A is obtained, and the first video stream and the second video stream A are displayed on the interface of the public channel of the viewer client 221.
[0070] It can be seen that the A audience client and the B audience client are in the same channel. The audience in this channel can first obtain a first video stream, and then according to the viewer's choice, obtain a second video related to a host Stream, if the viewer wants to change the commentary anchor, that is, to change the second video stream, they only need to select the corresponding identification information, obtain the second video stream corresponding to the identification information, and replace the original second video stream. This is not only simple to operate, but also maintains the continuity of the live broadcast, and will not let the audience miss any pictures in the first video stream.
[0071] In practical applications, some viewers want to watch the anchor’s commentary after entering the public channel. Therefore, in some cases, when entering the public channel, the first video stream obtained from the server can also be received randomly sent by the server. Second video stream, the second video stream randomly sent by the server is sent to the server by one of the host clients; before the user instruction triggered by the user for one of the identification information is received, the second video stream randomly sent by the server is displayed on the public channel. The first video stream.
[0072] In practical applications, in order to reduce the occupation of network bandwidth, in some examples, the server combines the acquired first video stream with each second video stream to synthesize the target video stream, and displays the first video stream in the public channel of the viewer client. A video stream and the second video stream are target video streams corresponding to the identification information. For example: the server obtains the first video stream and the second video stream A, and combines the second video stream A and the first video stream into the target video stream A, where the first video stream and the second video stream A are in the target video stream A It can be displayed as a picture-in-picture. Similarly, the server obtains the first video stream and the second video stream B, and combines the second video stream B and the first video stream into the target video stream B. When the viewer client selects the second video stream A When the corresponding identification information A, the audience client obtains the target video stream A from the server. When the audience client selects the identification information B corresponding to the second video stream B, the audience client obtains the target video stream B from the server, and the audience client The standard video stream B is displayed in the public channel of the terminal.
[0073] Of course, other methods can be used to reduce the network bandwidth usage. In some cases, the server crops or compresses the acquired second video stream, and then sends the cropped or compressed video stream to the viewer. Client.
[0074] The interaction between the audience and the host, and the interaction between the audience and the audience is a major feature of webcasting. In practical applications, when viewer A watches the commentary of anchor A on the first video stream, they do not want to see anchor B and watch anchor B's commentary. In order to solve the above problems, in some cases, the audience client obtains all the interactive information of the public channel from the server. The interactive information in this application includes chat information, barrage information, gift information, etc. Take the barrage information as an example. After the client of A viewer receives a user instruction triggered by the user for one of the identification information, for example, the viewer A selects the identification information A corresponding to the anchor client of A, and other identifications except the identification information A are blocked The barrage information corresponding to the information displays the interactive information corresponding to the identification information A in the public channel of the client A corresponding to the viewer A, that is, only the barrage information released by the viewers who watch the anchor A and who are watching the commentary of the anchor A are displayed. Especially when the interactive information is gift information, since the virtual gift presented by the viewer in the channel is generally converted into the income of the corresponding anchor of the channel according to the value of the virtual gift, the viewer is located in the same public channel in this application. If the viewer is not gifted Distinguishing the objects of the virtual gift will bring great trouble to the subsequent calculation of the income of each anchor. In some cases, all interactive information can be displayed in a public channel.
[0075] In practical applications, it is necessary to ensure the synchronization between the first video stream and the second video stream. For example, if the first video stream is a live video stream of a football match, if the second video stream for the host's explanation cannot be the same as the first video stream Synchronization, it is easy to cause the content of the host’s commentary to not match the picture played by the first video stream, resulting in poor viewing effect of the audience. In order to solve the above problem, in some examples, the server searches for the corresponding first video stream according to the identification information. Second video stream; according to the timestamp, the second video stream that matches the current frame of the first video stream is sent to the viewer client; the viewer client receives the second video stream sent by the server. In some examples, the first video stream and the second video stream may be unrelated, so the first video stream and the second video may not be synchronized. Whether the first video stream and the second video stream of this application need to be synchronized depends on specific application scenarios.
[0076] Of course, the live broadcast method proposed in the embodiment of the present application can not only be used in interpretive live broadcast. In some examples, the first video stream and the second video stream may be unrelated.
[0077] In some examples, the viewer can select multiple identification information at the same time, and display the video stream corresponding to the identification information in the public channel of the viewer client.
[0078] Corresponding to the foregoing embodiment of the live broadcast method, the present application also provides an embodiment of a live broadcast device.
[0079] The embodiments of the live broadcast device of this application can be applied to electronic equipment. The device embodiments can be implemented by software, or can be implemented by hardware or a combination of software and hardware. Taking software implementation as an example, as a logical device, it is formed by reading the corresponding computer program instructions in the non-volatile memory into the memory through the processor of the electronic device where it is located. From the hardware level, such as Figure 5 Shown is a hardware structure diagram of the electronic equipment where the live broadcast device of this application is located, except Figure 5 In addition to the processor, memory, network interface, and non-volatile memory shown, the electronic device in which the device is located in the embodiment generally may include other hardware according to the actual function of the electronic device, which will not be repeated here.
[0080] In some examples, the processor is coupled to the memory, and is used to read software and files stored in the memory and respond by performing the following operations:
[0081] When entering a public channel, obtain the first video stream from the server, and the public channel displays identification information of each anchor client;
[0082] When a user instruction triggered by the user for one of the identification information is received, the second video stream corresponding to the identification information is obtained from the server. The second video stream is a video stream sent by the second host client to the server. The first video stream and the second video stream are displayed in the channel.
[0083] Please refer to Image 6 , A live broadcast system includes: a host client device 610, a server 620, and a viewer client device 630,
[0084] The host client device 610 includes a communication module 611 and a processing module 612;
[0085] The communication module 610 is used to connect the microphones through its own identification information and public channel identification information,
[0086] The processing module 612 is configured to obtain its own identification information and the second video stream captured by the camera of the terminal where it is located, and send the second video stream and the identification information to the server 620;
[0087] The audience client device 630 includes a processing module 631 and a display module 632,
[0088] The processing module 631 is configured to obtain the first video stream from the server 620 when entering a public channel, the public channel displaying identification information of each anchor client;
[0089] When a user instruction triggered by the user for one of the identification information is received, obtain 620 from the server a second video stream corresponding to the identification information, where the second video stream is a video stream sent by the second host client to the server;
[0090] The display module 632 is configured to display the first video stream and the second video stream in a public channel.
[0091] In some examples, the server 620 is used to store the second video stream corresponding to each host client.
[0092] In some examples, the server 620 is configured to separately synthesize the acquired first video stream and each channel of the second video stream into the target video stream;
[0093] The display module 632 of the viewer client device 630 is configured to display the first video stream and the second video stream in the public channel as the target video stream corresponding to the identification information.
[0094] Please refer to Figure 7 , A live broadcast device 700, including:
[0095] The processing module 701 is configured to obtain the first video stream from the server when entering a public channel, and the public channel displays identification information of each anchor client;
[0096] When a user instruction triggered by a user for one of the identification information is received, obtaining a second video stream corresponding to the identification information from the server, where the second video stream is a video stream sent to the server by the second host client;
[0097] The display module 702 is configured to display the first video stream and the second video stream in a public channel.
[0098] In some examples, the processing module 701 is configured to receive a second video stream randomly sent by the server when entering a public channel. The second video stream randomly sent by the server is sent to the server by one of the host clients; Before the user instruction triggered by the user for one of the identification information, the second video stream and the first video stream randomly sent by the server are displayed on the public channel.
[0099] In some examples, the manner in which the display module 702 displays the first video stream and the second video stream includes separate display, or picture-in-picture display, or rear left display, or top and bottom display.
[0100] In some examples, the identification information may include any of the following: the host's ID number, the host's name, the host's avatar, and the host's popularity.
[0101] In some examples, the processing module 701 obtains from the server at least one of the following interactive information of at least one host client of the public channel: chat information, barrage information, and gift information. After receiving a user instruction triggered by the user for one of the identification information , Shielding the interaction information corresponding to other identification information except the identification information, and displaying the interaction information corresponding to the identification information in the public channel.
[0102] In some examples, the first video stream may include: a video stream stored on the server, or a video stream sent to the server by other terminals; the first video stream includes a program stream obtained from a broadcast television network, and the The second video stream is a video stream used by the host to explain the program stream.
[0103] As for the device embodiment, since it basically corresponds to the method embodiment, the relevant part can refer to the part of the description of the method embodiment. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present application. Those of ordinary skill in the art can understand and implement it without creative work.
[0104] The above descriptions are only the preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in this application Within the scope of protection.
