A live broadcast display method, device, equipment, storage medium and product

Abstract

Embodiments of the present application disclose a live broadcast display method, apparatus, device, storage medium and product. The method includes: displaying a live broadcast interface of a target anchor account, where the live broadcast interface displays the live broadcast content of the target anchor account. In response to a display operation on the target interface, displaying the target interface, where the target interface includes an anchor avatar area for displaying the avatar of the target anchor account, and displaying the live broadcast content of the target anchor account in the anchor avatar area. Embodiments of the present application achieve ensuring the playback continuity of the live broadcast content without affecting the user experience.

Description

Technical Field

[0001] The present invention relates to the field of the Internet, and in particular, to a live broadcast display method, device, equipment, storage medium and product. Background Art

[0002] Since the duration of a live broadcast is usually long, viewers often have the need to exit the live broadcast room to browse other content while hoping that the live broadcast content can continue to be displayed. In the current conventional solutions, to meet the need for viewers to watch the live broadcast continuously, generally, after the viewer leaves the live broadcast room and enters another interface, a floating small window is displayed in the other interface, and the live broadcast content is played in the floating small window. However, when the viewer operates in the other interface, it is easy to accidentally touch the floating small window, resulting in a poor user experience. Therefore, how to ensure the continuity of the live broadcast content without affecting the user experience after the viewer exits the live broadcast room is a problem worthy of consideration. Summary of the Invention

[0003] The technical problem to be solved by the embodiments of the present invention is to provide a live broadcast display method, device, equipment, storage medium and product, which realizes ensuring the continuity of the live broadcast content without affecting the user experience.

[0004] In a first aspect, an embodiment of the present invention provides a live broadcast display method, including:

[0005] Display a live broadcast interface of a target anchor account, where the live broadcast interface displays the live broadcast content of the target anchor account;

[0006] In response to a display operation of a target interface, display the target interface, where the target interface includes an anchor avatar area for displaying the avatar of the target anchor account;

[0007] Display the live broadcast content of the target anchor account in the anchor avatar area.

[0008] It can be seen that in the embodiments of the present application, the live broadcast interface of the target anchor account can be displayed, and then in response to the display operation of the target interface, the target interface is displayed, and the target interface includes an anchor avatar area for displaying the avatar of the target anchor account. Since the anchor avatar area is a fixed area in the target interface and does not block other content in the target interface, the live broadcast content of the target anchor account can be displayed in the anchor avatar area, so that when the viewer operates in the target interface, the risk of accidental touch can be effectively reduced, and the user experience is improved. Thus, it can be realized to ensure the continuity of the live broadcast content without affecting the user experience.

[0009] In an optional implementation manner, the method further includes:

[0010] In response to a sliding operation on the target interface, a target small window is displayed in the target interface, and the live content of the target anchor account is displayed through the target small window.

[0011] In an alternative embodiment,

[0012] In response to a display operation of the target interface, displaying the target interface includes:

[0013] In response to an anchor information display operation, switching from the live interface to the target interface, where the target interface is the first anchor information interface of the target anchor account; or,

[0014] In response to a follow list query operation, switching from the live interface to the target interface, where the target interface is the follow list interface; or,

[0015] In response to an anchor information display operation, superimposing and displaying the target interface on the live interface, where the target interface is the second anchor information interface of the target anchor account.

[0016] In an alternative embodiment, the target interface is the first anchor information interface of the target anchor account, and the first anchor information interface includes a first layer and a second layer, where the second layer is located above the first layer;

[0017] The step of, in response to a sliding operation on the target interface, displaying a target small window in the target interface includes:

[0018] In response to a sliding operation on the first anchor information interface, sliding the first layer;

[0019] In response to the anchor avatar area being partially or fully blocked during the sliding of the first layer, displaying a target small window in the first anchor information interface and displaying the avatar of the target anchor account in the second layer.

[0020] In an alternative embodiment, the live interface includes an anchor content display area;

[0021] The method further includes:

[0022] If the target interface is the second anchor information interface, then in response to a size adjustment operation on the second anchor information interface, adjusting the occlusion range of the second anchor information interface on the anchor content display area;

[0023] In response to the occlusion range being less than a preset threshold, redisplaying the live content of the target anchor account in the anchor content display area and displaying the avatar of the target anchor account in the anchor avatar area.

[0024] In an alternative embodiment, the live broadcast interface includes an interface switching control;

[0025] The displaying the target interface in response to a display operation of the target interface includes:

[0026] In response to a control trigger operation on the interface switching control in the live broadcast interface, switching the display of the live broadcast interface to the target interface; the target interface includes any one of a follow list interface, a first host information interface, or a live broadcast recommendation interface.

[0027] In an alternative embodiment,

[0028] The live broadcast interface is obtained by the server performing a screen scaling process on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target host account received;

[0029] The displaying the live content of the target host account in the host avatar area includes:

[0030] If the type of the live data is the first type, receiving a first encoded data stream sent by the server for the live data, and obtaining the live data and preset area coordinates associated with the key coordinates of the screen from the first encoded data stream; the preset area coordinates are the coordinates of the center area of the screen in the live data processing screen, and the center area of the screen is determined by the server in the live data processing screen based on the first type and the key coordinates of the screen;

[0031] Performing data processing on the live data based on the preset area coordinates and the area coordinates of the host avatar area to obtain the live content of the target host account, and displaying the live content of the target host account in the host avatar area; the live content of the target host account is part of the data content in the live data.

[0032] In an alternative embodiment, the method further includes:

[0033] In response to a data sliding operation on the live content of the target host account, determining a pixel offset value of the sliding operation based on the sliding trajectory corresponding to the sliding operation;

[0034] Update the live content of the target anchor account based on the pixel offset value, the preset area coordinates, and the area coordinates of the anchor avatar area to obtain updated live content, and display the updated live content in the anchor avatar area.

[0035] In an alternative embodiment,

[0036] The live broadcast interface is obtained by the server performing screen scaling processing on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target anchor account received;

[0037] The displaying the live content of the target anchor account in the anchor avatar area includes:

[0038] If the type of the live data is the second type, receive the second encoded data stream sent by the server for the live data, and obtain the live data and the anchor area coordinates associated with the key coordinates of the screen from the second encoded data stream; the anchor area coordinates refer to the coordinates of the anchor area recognized by the server in the live data processing screen, and the anchor area is determined by the server based on the second type and the key coordinates of the screen to identify the people in the live data processing screen;

[0039] Based on the anchor area coordinates and the area coordinates of the anchor avatar area, perform data processing on the live data to obtain the live content of the target anchor account, and display the live content of the target anchor account in the anchor avatar area; the live content of the target anchor account is the partial data content corresponding to the anchor in the live data.

[0040] In a second aspect, an embodiment of the present invention provides a live broadcast display device, including:

[0041] A display unit for displaying a live broadcast interface of a target anchor account, where the live broadcast interface displays the live content of the target anchor account;

[0042] The display unit is further configured to display the target interface in response to a display operation of the target interface, where the target interface includes an anchor avatar area for displaying the avatar of the target anchor account;

[0043] The display unit is further configured to display the live content of the target anchor account in the anchor avatar area.

[0044] Third aspect, an embodiment of the present invention provides a computer device, which includes a memory, a communication interface, and a processor. Among them, the memory, the communication interface, and the processor are interconnected; the memory stores a computer program, and the processor calls the computer program stored in the memory to implement the method described in the first aspect above.

[0045] Fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, it implements the method described in the first aspect.

[0046] Fifth aspect, an embodiment of the present invention provides a computer program product, which includes computer program code. When the computer program code runs on a computer, it causes the computer to execute the method described in the first aspect above.

[0047] Sixth aspect, an embodiment of the present invention provides a computer program, which includes computer program code. When the computer program code runs on a computer, it causes the computer to execute the method described in the first aspect above. Description of the Drawings

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background art, the following will describe the drawings required to be used in the embodiments of the present invention or the background art.

[0049] Figure 1 It is a schematic diagram of the system architecture of a live broadcast display method provided by an embodiment of the present application;

[0050] Figure 2 It is a flowchart of a live broadcast display method provided by an embodiment of the present application;

[0051] Figure 3 It is a schematic diagram of the display of the first host information interface provided by an embodiment of the present application;

[0052] Figure 4 It is a schematic diagram of the display of the follow list interface provided by an embodiment of the present application;

[0053] Figure 5 It is a schematic diagram of the display of the host group chat interface of the target host account provided by an embodiment of the present application;

[0054] Figure 6 It is a schematic diagram of the display of the live broadcast recommendation interface provided by an embodiment of the present application;

[0055] Figure 7 It is a schematic diagram of the second host information interface provided by an embodiment of the present application;

[0056] Figure 8 It is a schematic diagram of another second host information interface provided by an embodiment of the present application;

[0057] Figure 9 It is a schematic diagram of switching from the second host information interface to the first host information interface provided by an embodiment of the present application;

[0058] Figure 10 It is a schematic diagram of a content publishing interface provided by an embodiment of the present application;

[0059] Figure 11 It is a schematic diagram of preset area coordinate adjustment provided by an embodiment of the present application;

[0060] Figure 12 It is an interaction flow chart between the server and the viewer client provided by an embodiment of the present application;

[0061] Figure 13 It is a schematic diagram of a target small window sliding display in the first host information interface provided by an embodiment of the present application;

[0062] Figure 14 It is a schematic diagram of the first host information interface sliding provided by an embodiment of the present application;

[0063] Figure 15 It is a schematic diagram of a live display device provided by an embodiment of the present application;

[0064] Figure 16 It is a schematic diagram of the structure of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0065] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0066] Before further explaining the embodiments of the present application, the following explanations are made for the nouns involved in the embodiments of the present application.

[0067] Live broadcast is a way of information network publishing with a two-way communication process, which synchronously produces and publishes information on-site along with the occurrence and development process of an event. For example, data of the live broadcast party (i.e., the host account) can be collected through specific devices, and after a series of processes (such as being compressed into a viewable and transmissible video stream based on video coding technology), it is output to the viewing user side (i.e., the viewer account), thereby realizing the live broadcast.

[0068] To better understand a live broadcast display method disclosed in an embodiment of the present application, the system architecture applicable to the embodiment of the present application will be described below.

[0069] Please refer to Figure 1 , Figure 1 which is a schematic diagram of the system architecture of a live broadcast display method provided by an embodiment of the present application. As Figure 1 shown, the system architecture may include at least one server, at least one viewer client, and at least one host client. Among them, the target host account uploads live broadcast content to the server through the host client, so that the viewer client accessing the target host account can send a pull request for the live broadcast content of the target host account to the server. After receiving the pull request, the server can send the live broadcast content of the target host account to the viewer client. After receiving the live broadcast content, the viewer client can display the live broadcast content in the live broadcast interface of the target host account. Then, the viewer client can respond to the display operation of the target interface and display a target interface including a host avatar area for displaying the avatar of the target host account, and display the live broadcast content in the host avatar area in the target interface. This is because in actual application scenarios (such as video streaming platforms, online live broadcast platforms, and social media platforms, etc.), usually the duration of a live broadcast is relatively long. Therefore, viewers will switch from the live broadcast interface to the target interface to browse the information in the target interface, but hope to continue watching the live broadcast at the same time. Therefore, the live broadcast content of the target host account can be continuously displayed in the host avatar area of the target interface to meet the viewers' need to continue watching the live broadcast. And since the host avatar area is an area included in the target interface, it does not block other content in the target interface. Therefore, for the live broadcast content displayed on the host avatar area, when viewers browse other content in the target interface, it can effectively prevent viewers from accidentally touching the live broadcast content, and the live broadcast content does not block the viewers' browsing content in the target interface. Thus, while not affecting the viewers' viewing experience, the continuity of the live broadcast is ensured.

[0070] Among them, the live content refers to the data content generated during the live broadcast of the target anchor account through the anchor client, which may include the video data content and the audio data content of the live broadcast, etc. The display operation refers to an operation method for switching the display from the current interface to other interfaces, and the display operation may include operations such as voice commands, swiping, or clicking, and the specific operation behaviors are not limited. The live broadcast interface refers to an interface for displaying the live content of the target anchor account and capable of responding to interactive operations (such as comment, like, and co-hosting, etc.) for the live content. The target interface refers to an interface that the viewer client switches to and displays from the live broadcast interface in response to the display operation, and the target interface includes an anchor avatar area, and the anchor avatar area is used to display the avatar of the target anchor account. The avatar of the target anchor account refers to a picture set by the target anchor account for identifying the account, which may include a static picture or a dynamic picture.

[0071] It can be understood that the above clients (such as the viewer client and the anchor client) can be application programs for users to operate and log in to the live broadcast platform to meet the needs of users for live broadcasting or watching live broadcasts. The application program can be an independent application program installed in the user's electronic device, or a web version of the live broadcast client, that is, the user can use the electronic device to open the corresponding live broadcast web page through application programs such as browsers, and watch or start a live broadcast on the web page. The live broadcast platform is a multi-functional network live broadcast platform that integrates audio, video, desktop sharing, document sharing, and interactive sessions by using the Internet and multimedia communication technologies to meet the real-time social needs. Enterprises or individuals can use this live broadcast platform to conduct comprehensive exchanges and interactions of voice, video, and data online. Among them, the electronic device includes but is not limited to: smart phones (such as Android phones, iOS phones, etc.), tablet computers, portable personal computers, mobile Internet devices (MID), etc.

[0072] The above server can be an independent physical server, or a server cluster composed of multiple physical servers (for example, a streaming media processing server can be used to perform related media processing on the live data uploaded by the host client, such as video encoding, transcoding, or auditing, etc., and then a source server can be used to store the processed media data such as live data, etc., and can perform image recognition and other processing on the live data, and can also return relevant live data after receiving an access request from the client). It can also be a distributed system, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN), and big data and artificial intelligence platforms. The embodiments of the present invention do not make limitations in this regard.

[0073] In one implementation, a live display method provided in an embodiment of the present application can be implemented by a viewer client. Please refer to Figure 2 , Figure 2 which is a flowchart of a live display method provided in an embodiment of the present application. As Figure 2 shown.

[0074] S201. Display a live interface of a target host account, and the live interface displays the live content of the target host account.

[0075] In a possible case, the live interface of the target host account can be displayed when the viewer account accesses the live content of the target host account through a service interface including a host avatar area, and then the target interface is displayed in response to the display operation of the target interface, that is, the service interface including the host avatar area can be displayed in response to the display operation of the service interface including the host avatar area. The service interface including the host avatar area can include a first host information interface, a follow list interface, a host group chat interface, or a live recommendation interface, etc. The specific implementation method is as follows.

[0076] In one implementation, before displaying the live interface of the target anchor account, a first anchor information interface can be displayed. The first anchor information interface includes an anchor avatar area of the target anchor account. In response to a live access operation for the target anchor account in the first anchor information interface (i.e., a click operation on the anchor avatar area of the target anchor account, or a relevant voice command operation for instructing to display the live interface of the target anchor account, etc.), the live interface of the target anchor account can be displayed. It is possible to switch from the live interface to the first anchor information interface in response to an anchor information display operation. At this time, the anchor information display operation can be understood as the display operation of the target interface in step S202, and the first anchor information interface can be understood as the target interface in step S202. The live content of the target anchor account can be displayed in the anchor avatar area of the first anchor information interface.

[0077] Among them, the first anchor information interface is an interface for displaying the detailed information of the anchor of the target anchor account. The detailed information of the anchor of the target anchor account may include the account name of the target anchor account, personal introduction, historical published content, associated account information of the target anchor account (i.e., the accounts followed by the target account or the accounts following the target anchor account, etc.). Exemplarily, reference can be made to Figure 3 , Figure 3 is a display schematic diagram of the first anchor information interface. As Figure 3 shown, interface 301 is the first anchor information interface. In the first anchor information interface, 31a is the anchor avatar area of the target anchor account. In response to a region trigger operation on the anchor avatar area, interface 302 is displayed, that is, the live interface of the target anchor account. Then, in response to the anchor information display operation, the live interface in the viewer client is switched to display interface 303, that is, the first anchor information interface, and the live content corresponding to the target anchor account is displayed in the anchor avatar area 32a of the first anchor information interface.

[0078] In an alternative implementation, before displaying the live interface of the target anchor account, a follow list interface can be displayed. The follow list interface includes an anchor avatar area of the target anchor account. In response to a live access operation for the target anchor account in the follow list interface, the live interface of the target anchor account can be displayed. It is possible to switch from the live interface to the follow list interface in response to a follow list query operation. At this time, the follow list query operation can be understood as the display operation of the target interface in step S202, and the follow list interface can be understood as the target interface in step S202. The live content of the target anchor account can be displayed in the anchor avatar area of the follow list query interface.

[0079] Among them, the watch list interface refers to the list of accounts followed by the viewer account corresponding to the viewer client, and this list includes the target anchor account. Exemplarily, reference can be made to Figure 4 , Figure 4 which is a schematic diagram of the display of the watch list interface. As shown in Figure 4 , interface 401 is the watch list interface of the viewer account. In this watch list interface, 41a is the anchor avatar area of the target anchor account. In response to a regional trigger operation on the anchor avatar area, interface 402 is displayed, that is, the live broadcast interface of the target anchor account. Then, in response to a watch list query operation, the live broadcast interface in the viewer client is switched to display interface 403, that is, this watch list interface, and the live broadcast content of the target anchor account is displayed in the anchor avatar area 42a in this watch list interface.

[0080] In one implementation, before displaying the live broadcast interface of the target anchor account, a host group chat interface can be displayed. This host group chat interface includes the anchor avatar area of the target anchor account. In response to a trigger operation on the anchor avatar area, the live broadcast interface of the target anchor account can be displayed. In response to a host group chat display operation, the live broadcast interface can be switched to this host group chat interface. At this time, the host group chat display operation can be understood as the display operation of the target interface in step S202, and the host group chat interface can be understood as the target interface in step S202. The live broadcast content of the target anchor account can be displayed in the anchor avatar area in this host group chat interface.

[0081] Among them, the host group chat interface refers to a chat interface created by the target anchor account and associated with multiple clients. These multiple clients include the viewer client. The host group chat interface can be displayed in any associated client. The host group chat interface can, in response to a text input operation or a voice input operation of any associated client, display the input content in the host group chat interfaces of all associated clients. Exemplarily, reference can be made to Figure 5 , Figure 5 which is a schematic diagram of the display of the host group chat interface of the target anchor account. As shown in Figure 5 , interface 501 is the host group chat interface of the target anchor account. In the host group chat interface of the target anchor account, 51a is the anchor avatar area of the target anchor account. In response to a regional trigger operation on the anchor avatar area, interface 502 is displayed, that is, the live broadcast interface of the target anchor account. Then, in response to a host group chat display operation, the live broadcast interface in the viewer client is switched to display interface 503, that is, the host group chat interface of the target anchor account, and the live broadcast content of the target anchor account is displayed in the anchor avatar area 52a in the host group chat interface of the target anchor account.

[0082] Optionally, when session prompt text for switching to the live broadcast interface is displayed in the host group chat interface, the host group chat interface can be switched to the live broadcast interface by triggering the session prompt text.

[0083] In one implementation, before displaying the live broadcast interface of the target host account, a live broadcast recommendation interface can be displayed. The live broadcast recommendation interface includes a live broadcast cover area of the target host account, and a host avatar area of the target host account is displayed in the live broadcast cover area. In response to a trigger operation on the live broadcast cover area of the target host account, the live broadcast interface of the target host account can be displayed. In response to a live broadcast recommendation display operation, the live broadcast interface can be switched to the live broadcast recommendation interface. At this time, the live broadcast recommendation display operation can be understood as the display operation of the target interface in step S202, and the live broadcast recommendation interface can be understood as the target interface in step S202. The live broadcast content of the target host account can be displayed in the host avatar area in the live broadcast recommendation interface.

[0084] The live broadcast recommendation interface is an interface for displaying the live broadcast covers of each host account currently in the live broadcast state. Among them, each host account includes the target host account, and the live broadcast covers of each host account can include pictures or video data set by each host account, or intercepted segment videos of the live broadcast content of each host account, etc. Exemplarily, reference can be made to Figure 6 , Figure 6 is a display schematic diagram of the live broadcast recommendation interface. As Figure 6 shown, interface 601 is the live broadcast recommendation interface. In the live broadcast recommendation interface, 61a is the live broadcast cover of the target host account, where 62a indicates that the target host account is in the live broadcast state, and 63a is the host avatar area of the target host account. In response to a trigger operation on the live broadcast cover of the target host account, interface 602 is displayed. Interface 602 is the live broadcast interface of the target host account. Then, in response to the live broadcast recommendation display operation, the live broadcast interface in the viewer client is switched to interface 603, that is, the live broadcast recommendation interface, and the live broadcast content of the target host account is displayed in the host avatar area 64a in the live broadcast recommendation interface.

[0085] S202. In response to the display operation of the target interface, display the target interface.

[0086] Among them, the target interface includes a host avatar area, which is used to display the avatar of the target host account. In one possible case, the viewer account can access the live content of the target host account through this target interface to display the live interface of the target host account, as specifically described in step S201; in another possible case, the target interface can be a specified service interface, that is, regardless of which service interface the viewer account accesses the live content of the target host account to display the live interface of the target host account, the target interface can be displayed in response to the display operation of the target interface. The target interface can be specified as any one of the above-mentioned first host information interface, follow list interface, host group chat interface, or live recommendation interface, etc., or it can also be the second host information interface, which is not limited in the embodiments of the present application.

[0087] The display operation of the target interface can include a sliding operation (such as swiping up, down, left, or right, and the specific sliding method is not limited), a voice command operation indicating the display of the target interface, a query operation for the target interface, or a trigger operation for a control, etc., and the specific display operation method is not limited. Specifically, for example, the live interface can include an interface switching control. Responding to the display operation of the target interface to display the target interface can be responding to the trigger operation for the interface switching control in the live interface to switch the display from the live interface to the target interface.

[0088] Since the interface schematic diagrams of the first host information interface, follow list interface, host group chat interface, and live recommendation interface, etc. have been shown in step S201, they will not be elaborated here. The following describes the detailed content of the second host information interface.

[0089] In one implementation manner, the target interface can be the second host information interface, and the second host information interface of the target host account can be superimposed and displayed on the live interface in response to the host information display operation. The second host information interface includes the host avatar area. The live content of the target host account can be displayed in the host avatar area in the second host information interface. Among them, the second host information interface is an interface for displaying some host details information of the target host account, that is, the content displayed in the second host information interface is a part of the content displayed in the first host information interface. For example, some host details information of the target host account can include the account name of the target host account, historical published content, etc.

[0090] Specifically, the live interface can include the live avatar of the target host account. Responding to the trigger operation for the live avatar, that is, the host information display operation, the second host information interface can be superimposed and displayed on the live interface. Exemplarily, please refer to Figure 7 , Figure 7It is a schematic diagram of the second host information interface. As Figure 7 shown, the interface 701 is the live broadcast interface, where 701a is the live broadcast avatar display area. In response to a trigger operation on this live broadcast avatar display area, the second host information interface is superimposed and displayed on the live broadcast interface. The host avatar area in the second host information interface shown in the interface 702 displays the live broadcast content of the target host account.

[0091] It can be understood that the live broadcast interface may include a host content display area for displaying the live broadcast content of the target host account. In response to a host information display operation, the second host information interface of the target host account is superimposed and displayed on this live broadcast interface. Since the second host information interface superimposed on the live broadcast interface will block the host content display area in this live broadcast interface, the viewer client can, in response to a size adjustment operation on this second host information interface (for example, a sliding operation on this second host information interface), adjust the blocking range of this second host information interface on the host content display area. In response to the blocking range being less than a preset threshold, the live broadcast content of the target host account can be redisplayed in this host content display area, and the avatar of the target host account can be displayed in the host avatar area in this second information interface.

[0092] Specifically, there can be two situations. One situation can be that the live broadcast interface of the target host account is displayed. In response to a host information display operation, the second host information interface is superimposed and displayed in this live broadcast interface. If the blocking range of this second information interface on the host content display area is greater than or equal to the preset threshold, the live broadcast content of the target host account can be displayed in the host avatar area in this second host information interface. Then, in response to a size adjustment operation on this second host information interface, the blocking range of this second host information interface on the host content display area can be adjusted. In response to the blocking range being less than the preset threshold, the live broadcast content of the target host account can be redisplayed in the host content display area, and the avatar of the target host account can be displayed in the host avatar area in this second host information interface (i.e., the second host information interface after size adjustment). Exemplarily, please refer to Figure 8 It is a schematic diagram of another second host information interface. As Figure 8As shown, the interface 801 is a live broadcast interface, where 81a is the live broadcast avatar. In response to a trigger operation on the live broadcast avatar, a second host information interface is superimposed and displayed on the live broadcast interface. The occlusion range of the second host information interface on the host content display area is greater than or equal to a preset threshold, and the live broadcast content of the target host account is displayed in the host avatar area in the second host information interface. In response to a size adjustment operation on the second host information interface, the occlusion range is less than the preset threshold, and the interface 803 is displayed. In the interface 803, the live broadcast content of the target host account is redisplayed in the host content display area, and the avatar of the target host account is displayed in the host avatar area in the second host information interface.

[0093] Another situation can be that the live broadcast interface of the target host account is displayed. In response to a host information display operation, a second host information interface is superimposed and displayed in the live broadcast interface. If the occlusion range of the second host information interface on the host content display area is less than the preset threshold, the live broadcast content of the target host account can be displayed in the host content display area, and the avatar of the target host account is displayed in the host avatar area in the second host information interface.

[0094] Further, in response to a region trigger operation on the host avatar area in the second host information interface, a first host information interface can be displayed, and the live broadcast content of the target host account can be displayed in the host avatar area in the first host information interface. Exemplarily, please refer to Figure 9 , Figure 9 is a schematic diagram of switching from the second host information interface to the first host information interface. As shown in Figure 9 , the interface 901 is a live broadcast interface, where 91a is the live broadcast avatar. In response to a trigger operation on the live broadcast avatar, a second host information interface is superimposed and displayed on the live broadcast interface. In response to a region trigger operation on the host avatar area in the second host information interface, the interface 903, that is, the first host information interface, can be displayed, and the live broadcast content of the target host account is displayed in the host avatar area 92a in the first host information interface.

[0095] Optionally, the second host information interface may include the historical published content published by the target host account. In response to a selection operation on any historical published content in the second host information interface, a published content interface corresponding to the any historical published content can be displayed. The published content interface includes a host avatar area for displaying the avatar of the target host account, and the live broadcast content of the target host account is displayed in the host avatar area in the published content interface. Exemplarily, please refer to Figure 10 , Figure 10 is a schematic diagram of the published content interface. As shown in Figure 10As shown, the interface 1001 is a live broadcast interface, where 101a is the live broadcast avatar. In response to a trigger operation on the live broadcast avatar, a second anchor information interface is superimposed and displayed on the live broadcast interface. The second anchor information interface includes the historical release content published by the target anchor account. In response to a selection operation on any historical release content in the second anchor information interface, the interface 1003 is displayed. The interface 1003 is the release content interface corresponding to any historical release content, and the release content interface includes an anchor avatar area 102a, and the live broadcast content corresponding to the target anchor account is displayed in the anchor avatar area.

[0096] S203. Display the live broadcast content of the target anchor account in the anchor avatar area.

[0097] Among them, displaying the live broadcast content of the target anchor account in the anchor avatar area means filling and displaying the live broadcast content of the target anchor account in the anchor avatar area, covering the avatar of the target anchor account. The live broadcast content of the target anchor account can be specifically obtained by the method in the following embodiments.

[0098] In one embodiment, the live broadcast interface of the target anchor account is used to display the live broadcast content of the target anchor account. Here, the live broadcast interface of the target anchor account is obtained by the server performing a screen scaling process on the screen display size of the terminal where the viewer client is located for the screen size of the live broadcast data processing screen corresponding to the live broadcast data. The screen size of the live broadcast data processing screen is determined by the server based on the key coordinates of the live broadcast data processing screen. Among them, it can be understood that the live broadcast data refers to the audio-visual data decoded by the server from the received live broadcast data stream (the audio-visual data can specifically include audio data and video data). Here, the live broadcast data processing screen refers to the frame screen of the video frame corresponding to the decoded video data. Among them, the key coordinates of the screen can include the diagonal coordinates of the live broadcast data processing screen or can also be the length and width coordinates of the live broadcast data processing screen, etc. The live broadcast data is determined by the server based on the live broadcast data stream uploaded by the target anchor account received.

[0099] Among them, the types of the live broadcast data (i.e., the live broadcast types) may include a first type and a second type. The first type may represent an entertainment type. At this time, the live broadcast data may be live broadcast data with the multimedia content being an online game or live broadcast data with the multimedia content being a multi-person voice connection. For the live broadcast data of the first type, the content that attracts the attention of the audience in the live broadcast interface mainly focuses on the central part of the live broadcast data processing screen. Therefore, in the embodiments of the present application, the area information (e.g., preset area coordinates, for example, when the shape of the central area of the screen is a rectangle, the preset area coordinates here may specifically include the starting coordinates of the central area of the screen, the length and width of the central area of the screen) of a preset display area (e.g., the central area of the screen) in the live broadcast data processing screen can be used. Among them, the starting coordinates here are determined based on the coordinates of a certain area key point (e.g., the vertex of the rectangle) of the central area of the screen in the live broadcast data processing screen. Among them, the second type may represent a language type. For example, the live broadcast data may be that the multimedia content is the host answering the comments of the audience or the host telling a message story or sharing his own experience or the host selling goods, etc., that is, the live broadcast data other than the first type. For the live broadcast data of the second type, the content that attracts the attention of the audience in the live broadcast interface mainly focuses on the display area where the person is located in the live broadcast data processing screen. Therefore, the host area indicated by the second type may be the display area where the host is located in the live broadcast data processing screen.

[0100] In a realizable manner, when the viewer client switches the live broadcast interface to the target interface, it may send a coordinate acquisition request for acquiring the target area coordinates to the server. For example, when the type of the live broadcast data is the first type, the target area coordinates here may be the preset area coordinates, that is, the preset area coordinates may be the coordinates of the central area of the screen determined in the live broadcast data processing screen. In this way, the server may acquire the preset area coordinates based on the coordinate acquisition request, and perform encoding processing on the preset area coordinates and the current live broadcast data and then return them to the viewer client.

[0101] Specifically, if the type of the live broadcast data is the first type, the viewer client may receive the first encoded data stream sent by the server for the live broadcast data, and may acquire the live broadcast data and the preset area coordinates associated with the key screen coordinates from the first encoded data stream. Further, the viewer client may perform data processing on the live broadcast data based on the preset area coordinates and the area coordinates of the host avatar area, obtain the live broadcast content of the target host account, and display the live broadcast content of the target host account in the host avatar area. Among them, the live broadcast content of the target host account is part of the data content in the live broadcast data. The preset area coordinates refer to the coordinates of the central area of the screen, and the central area of the screen is determined by the server in the live broadcast data processing screen based on the first type and the key screen coordinates.

[0102] Among them, the central area of the screen is an arbitrary-shaped area centered on the center point of the live data processing screen with a preset value for the size. Exemplarily, it can be a circular area centered on the center point of the live data processing screen with a preset value for the radius, or it can also be a square area centered on the center point of the live data processing screen with a preset value for the side length, or it can also be a rectangular area centered on the center point of the live data processing screen with a preset value for the length and width, etc. Since in the actual scenario, for the first type of live data, the sizes of all live data processing screens (i.e., all video frames) are the same, therefore, when determining the preset area coordinates for a certain video frame among all video frames, the preset area coordinates can be used as the preset area coordinates for other video frames, without the need for the server to repeatedly locate the preset area coordinates in each video frame. In this way, the waste of computing resources on the server can be avoided.

[0103] Among them, the first encoded data stream is obtained by the server re-encoding the live data decoded from the live data stream by using the preset area coordinates as supplemental enhancement information (SEI). Then, when the viewer client decodes the first encoded data stream, it can extract the SEI, that is, the preset area coordinates, and then based on the preset area coordinates and the area coordinates of the host avatar area, perform data processing on the live data to obtain the live content of the target host account. The live content can be understood as the live content matching the first type.

[0104] In another implementable manner, for example, when the type of the live data is the second type, the target area coordinates here can be the host area coordinates, that is, the host area coordinates can be the coordinates of the host area corresponding to the person identified in the live data processing screen. In this way, the server can also obtain the host area coordinates based on the coordinate acquisition request, and encode and process the preset area coordinates and the current live data together and then return them to the viewer client.

[0105] Specifically, if the type of the live data is the second type, the receiving server receives the second encoded data stream sent for the live data, and obtains the live data and the anchor area coordinates associated with the key screen coordinates from the second encoded data stream. Based on the anchor area coordinates and the area coordinates of the anchor avatar area, the live data is processed to obtain the live content of the target anchor account, and the live content of the target anchor account is displayed in the anchor avatar area. At this time, the live content of the target anchor account is the partial data content corresponding to the anchor in the live data. The anchor area is determined by the server based on the second type and the key screen coordinates to identify the people in the live data processing screen. Among them, the second encoded data stream is obtained by the server re-encoding the live data decoded from the live data stream with the anchor area coordinates as the Supplemental Enhancement Information (SEI). Then, when the viewer client decodes the second encoded data stream, it can extract the SEI, that is, the anchor area coordinates, and then based on the anchor area coordinates and the area coordinates of the anchor avatar area, process the live data to obtain the live content of the target anchor account, and this live content can be understood as the live content matching the second type. The anchor area coordinates are determined by the server (for example, the server side in the server) based on the anchor area where the people identified in each video frame (i.e., the live data processing screen) are located. Among them, the server (for example, the remote source station in the server) can identify the people in the live data processing screen through deep learning methods. For example, the server can use the Convolutional Neural Network (CNN) in deep learning methods to identify the people in each frame of the video data included in the live data, and the embodiments of the present application do not limit the deep learning methods used.

[0106] Further, the specific method for displaying the live content matching the first type or the live content matching the second type in the anchor avatar area is as follows.

[0107] In one implementation, the live content displayed in the host avatar area can be the first live content, where the first live content refers to the live content matching the first type. Specifically: The viewer client can obtain the coordinates of the host avatar area in the target interface for the host avatar area, and based on the preset area coordinates and the coordinates of the host avatar area, determine the scaling ratio. Furthermore, the viewer client can scale the playback video frame corresponding to the live data based on the scaling ratio to obtain the scaled playback video frame (i.e., the scaled video frame). Further, the viewer client can crop the scaled playback video frame (i.e., the scaled video frame) based on the coordinates of the host avatar area to obtain the cropped playback video frame. Thus, the cropped playback video frame can be played through a player on the playback view corresponding to the host avatar area, and the cropped playback video frame is the live content of the target host account.

[0108] Among them, the playback view refers to the view created by the viewer client on the host avatar area in the target interface (such as the first host information interface) when switching to the target (such as the first host information interface). The playback video frame here is the frame of the video data decoded from the first encoded data stream when displayed through the player in the viewer client. For example, in the live interface, the frame corresponding to the live content of the target host account displayed through the player in the viewer client can be the playback video frame.

[0109] In the embodiments of the present application, the player used to play the live content of the target host account in the live interface is the same player as the player used to play the live content of the target host account on the playback view.

[0110] Specifically, when the shape of the central area of the screen indicated by the preset area coordinates is the same as the area shape of the host avatar area, the length in the preset area coordinates can be scaled to be equal to the length in the area coordinates of the host avatar area, and the width in the preset area coordinates can be scaled to be equal to the width in the area coordinates of the host avatar area to obtain the scaled live content, and the live content is displayed in the host avatar area in the target interface.

[0111] When the shape of the central area of the screen indicated by the preset area coordinates is different from the area shape of the anchor avatar area, the length or width of the preset area coordinates can be adjusted based on the aspect ratio of the length and width of the area coordinates of the anchor avatar area, so that the aspect ratio of the adjusted preset area coordinates is the same as the aspect ratio of the area coordinates of the anchor avatar area. Then, based on the sum of the length and width of the area coordinates of the anchor avatar area and the sum of the length and width of the preset area coordinates, the scaling ratio of the live content is determined, and the live content is scaled to obtain the scaled live content, which is displayed in the anchor avatar area of the target interface.

[0112] Exemplarily, if the area shape of the anchor avatar area is circular and the screenshot shape of the central screenshot of the screen is rectangular. The area coordinates of the anchor avatar area can be (avatar_width, avatar_height), where avatar_width represents the length of the anchor avatar area and avatar_height represents the width of the anchor avatar area. Since the area shape of the anchor avatar area is circular, the length and width of the anchor avatar area are equal, that is, the length and width of the anchor avatar area are equal to the diameter of the anchor avatar area. The preset area coordinates can be (x, y, w, h), where x represents the starting horizontal coordinate of the central area of the screen in the live data processing screen, y represents the starting vertical coordinate of the central area of the screen in the live data processing screen, w represents the length of the central area of the screen, and h represents the width of the central area of the screen. If w is greater than h, and in the scaling process, the better the scaling effect is, the more image content in the central area of the screen is retained. Therefore, to make the aspect ratio of the adjusted preset area coordinates the same as the aspect ratio of the area coordinates of the anchor avatar area, h can be adjusted to the same length as w to obtain the adjusted preset area coordinates (x, y-(w-h) / 2, w, w), as Figure 11As shown in the schematic diagram of preset area coordinate adjustment. The scaling ratio ratio = w / avatar_width can be determined. Then, based on the scaling ratio, the playback video screen corresponding to the live data can be scaled to obtain the scaled playback video screen. In this way, after the server crops the scaled playback video screen, the cropped playback video screen can be displayed through the above playback view to achieve the view display effect of displaying the live content of the target anchor account in the anchor avatar area. Among them, the calculation process of determining the scaling ratio can be executed by the media processing module in the viewer client. Then, the player in the viewer client can scale the playback video screen corresponding to the live data based on the scaling ratio to obtain the scaled playback video screen. In this way, after the server crops the scaled playback video screen, the cropped playback video screen can be rendered and displayed on the above playback view through the player to achieve the view display effect of displaying the live content of the target anchor account in the anchor avatar area.

[0113] In the embodiment of the present application, the viewer client can play the live content corresponding to the live data decoded from the first encoded data stream through the player in the live interface of the target anchor account. Then, after the viewer client detects that the live interface is switched to the target interface, a new playback view can be created in the anchor avatar area, and the above preset area coordinates can be obtained from the received first encoded data stream. Furthermore, the media processing module in the viewer client can calculate the scaling ratio through the above determined scaling ratio calculation process. In this way, when there is a new playback view in the anchor avatar area, the viewer client can reuse the player in the original live interface to continue playing and displaying the live content of the target anchor account through this player.

[0114] For the specific method of displaying the live content matching the second type in the host avatar area, the specific method for determining the scaling ratio is the same as the method for determining the scaling ratio of the live content matching the first type described above, which will not be elaborated here. Since the live content matching the second type is obtained by processing the live data based on the host area coordinates and the area coordinates of the host avatar area, where the host area coordinates refer to the coordinates of the host area recognized by the server in the live data processing screen, which are obtained by the server recognizing the people in the live data processing screen. During the live broadcast, the display area (i.e., the host area) of the people in each video frame (i.e., the live data processing screen) decoded by the server may change due to the movement of the people over time. Therefore, the server can use deep learning or any existing face recognition technology to real-time recognize the coordinates of the host area where the people are located in the current live data processing screen (i.e., the host area coordinates). If the host area coordinates recognized by the server in the current video frame (i.e., the live data processing screen) are different from the previously recognized host area coordinates (e.g., the host area coordinates recognized in the previous video frame of the current video frame), the currently recognized host area coordinates (or it can also be the deviation information between the currently recognized host area coordinates and the previously sent host area coordinates) will be sent to the viewer client. After receiving the currently recognized host area coordinates (or deviation information), the viewer client will then process the live data based on the currently recognized host area coordinates (or update the previous host area coordinates based on the deviation information to obtain the updated host area coordinates) and the area coordinates of the host avatar area (i.e., determine a new scaling ratio, so that the player scales the playback video screen corresponding to the live data in the current second encoded data stream based on this new scaling ratio), so that subsequently, the live content matching the second type obtained by scaling and cropping the playback video screen can be rendered and displayed on the playback view corresponding to the host avatar area through the player.

[0115] It can be seen that in the embodiments of the present application, the live broadcast interface of the target host account can be displayed, and then in response to the display operation of the target interface, a target interface including the host avatar area is displayed, and the live content of the target host account is displayed in this host avatar area. Since the host avatar area is a specific display area in the target interface, displaying the live content of the target host account in this host avatar area will not block the content in the host information interface, thus greatly reducing the chance of accidental touch by the viewer in this host information interface. Therefore, it can ensure the continuity of the live broadcast without affecting the user experience.

[0116] To better understand this solution, the following uses the interaction process between the server, the viewer client, and the host client corresponding to the target host account to describe in detail the live display method provided in the embodiments of the present application. Please refer to Figure 12 , Figure 12 is the interaction flowchart between the server and the viewer client provided in the embodiments of the present application, as Figure 12 shown.

[0117] S1201. The host client sends a live data stream to the server.

[0118] S1202. When the server decodes the live data corresponding to the live data stream, it can perform frame extraction on the live data to obtain video frames associated with the video data in the live data; the video frames here are the live data processing pictures corresponding to the live data.

[0119] S1203. The server can determine the key coordinates of the live data processing picture and determine the target area coordinates associated with the key coordinates of the picture based on the type of the live data.

[0120] Among them, the target area coordinates can be the above-mentioned preset area coordinates or host area coordinates. The live data corresponding to the live data stream refers to the live data obtained by the server decoding the live data stream through the remote source station. It should be understood that the server here can also include a server other than the remote source station, that is, the server can be a service cluster composed of a remote source station and a streaming media processing server. Among them, the remote source station is used to receive the live data stream uploaded by the host client through the target host account and decode the live data stream through the remote source station to obtain the live data corresponding to the live data stream (that is, the above-mentioned audio and video data). In this way, the server can further perform frame extraction on the video data in the live data (that is, the above-mentioned audio and video data) through the remote source station, and collectively refer to the video frames obtained by the frame extraction as the above-mentioned live data processing pictures, so that the remote source station can identify the people in the live data processing pictures later.

[0121] Among them, when the host client collects live data, it can further perform streaming media processing on the live data (such as auditing, bitrate adjustment, and encoding, etc.) through the streaming media component corresponding to the host client, so as to send the audio and video bitstream (i.e., the live data stream) obtained after the streaming media processing to the server (specifically, it can refer to the remote source station in the server). It should be understood that in the embodiments of the present application, when the remote source station decodes the live data corresponding to the live data stream, it can further forward the live data to the server side, so that the server side can determine the type of the currently received live data based on the pre-stored live types. If the type of the live data is the first type, the server side can directly obtain the coordinates of the central area of the picture in the live data processing picture as the preset area coordinates, and here the preset area can be one of the target area coordinates. Optionally, if the type of the live data is the second type, the server side can directly obtain the coordinates of the host area in the live data processing picture as the host area coordinates, and here the host area can be another one of the target area coordinates.

[0122] It should be understood that after the remote source station decodes the live data stream to obtain the live data, it can further perform frame extraction processing on the video data in the live data, and then can perform human recognition (such as portrait recognition) on each video frame obtained by the frame extraction processing through a deep learning method. For example, specifically, the remote source station can perform frame extraction processing on the video data in the live data, that is, extract some key video frames, and then identify the people in each key video frame (referred to as each video frame for short) in the extracted part of the key video frames according to the type of the live data.

[0123] S1204. When the server performs streaming media processing on the live data, it can use the target area coordinates as supplementary enhancement information, and add the supplementary enhancement information to the encoded data stream corresponding to the live data to obtain the target encoded data stream corresponding to the encoded data stream.

[0124] It should be understood that in the embodiments of the present application, when the data type of the live data is the first type, the server can use the preset area coordinates as supplementary enhancement information, so as to perform encoding processing on the supplementary enhancement information and the encoded data stream corresponding to the live data to obtain the first encoded data stream, and here the first encoded data stream can be one of the target encoded data streams.

[0125] Optionally, when the data type of the live data is the second type, the server can use the coordinates of the host area as another supplementary enhancement information, so as to perform encoding processing on the another supplementary enhancement information and the encoded data stream corresponding to the live data to obtain the second encoded data stream, and here the second encoded data stream can be another one of the target encoded data streams.

[0126] S1205: The viewer client receives the target coded data stream sent by the server, decodes the target coded data stream, obtains the target area coordinates and live broadcast data, and displays the live broadcast content corresponding to the live broadcast data on the live broadcast interface.

[0127] It can be understood that the target encoded data stream can be obtained by the server (for example, the service end in the server) re-encoding the live broadcast data of the target anchor account obtained from the live broadcast data stream based on the pull stream request received from the viewer client.

[0128] The target coded data stream may be a first coded data stream or a second coded data stream. The first coded data stream includes live broadcast data and preset area coordinates; the second coded data stream includes live broadcast data and anchor area coordinates. The specific method for obtaining the preset area coordinates and anchor area coordinates can be seen in the description of the above step S203.

[0129] S1206: The viewer client displays the target interface in response to the display operation of the target interface.

[0130] The target interface includes a host avatar area, which is used to display the avatar of the target host account. The viewer client can respond to the viewer account accessing the target host account's room entry short link operation, generate an access request for the live content of the target host account through the corresponding network protocol of the room entry short link, and send the generated access request to the server to obtain the target encoded data stream of the target host account.

[0131] For details on the target interface, see the above Figure 2 The description in step S202 in the above description will not be repeated here. In possible cases, after the target interface is displayed in the viewer client, a target small window (e.g., a movable floating pop-up window) can be displayed in the target interface in response to a sliding operation, and the live content of the target anchor account can be displayed through the target small window. It can be understood that since the target interface is slid, the target interface after sliding may not display the anchor avatar area, that is, the target interface after sliding does not display the anchor avatar area in the display screen of the terminal where the viewer client is located. At the same time, because the target interface is in a sliding state, there is no problem of accidental touch. In order to increase the display area of ​​the live content, the target small window can be displayed, and the live content of the anchor account can be displayed in the target small window. Specifically, since the sliding operation is that the viewer object corresponding to the viewer account performs a long press operation on the target interface and then slides based on the long press operation, therefore, in response to the sliding operation, displaying the target small window in the target interface can be in response to the long press operation, and the target small window is displayed in the target interface; or, it can be in response to the long press operation and the sliding track, and the target small window is displayed in the target interface.

[0132] In a possible scenario, the target interface may be the first information interface, and the first host information interface may include a first layer and a second layer, where the second layer is located above the first layer. In response to a sliding operation on the target interface, a target small window is displayed in the target interface, that is, in response to a sliding operation on the first host information interface, the first layer is slid. In response to the fact that during the sliding of the first layer, the host avatar area is partially or completely blocked, the target small window is displayed in the first host information interface, and the avatar of the target host account is displayed in the second layer. Specifically, it may be that in response to the sliding of the first layer, the transparency of the second layer is adjusted until the transparency of the second layer reaches the transparency threshold, and then the host avatar area is partially or completely blocked by the second layer. Then, the target small window is displayed in the first host information interface, and the avatar of the target host account is displayed in the second layer. Exemplarily, reference may be made to Figure 13 the schematic diagram of the sliding display of the target small window in the shown first host information interface. Among them, interface 1301 is the first host information interface, where 131a is the host avatar area, and the live content of the target host account is displayed in the host avatar area. In response to a sliding operation on the first host information interface, interface 1302 is displayed. In interface 1302, the second layer partially blocks the host avatar area, and the live content of the target host account is displayed in the target small window 132a. Continuing to respond to the sliding operation on the first host information interface, interface 1303 is displayed. In interface 1303, the second layer completely blocks the host avatar area, and in the target small window 132a, the live content of the target host account is displayed.

[0133] In an implementation manner, the first host information interface may include a first layer and a second layer, where the second layer is located above the first layer. In response to a sliding operation on the first host information interface, the first layer is slid. In response to the fact that during the sliding of the first layer, the host avatar area is completely blocked, the avatar of the target host account is displayed in the second layer, and the live content of the target host account is displayed on the avatar. Exemplarily, reference may be made to Figure 14 the schematic diagram of the sliding of the shown first host information interface, as Figure 14 shown, interface 1401 is the first host information interface, where 141a is the host avatar area, and the live content of the target host account is displayed in the host avatar area. In response to a sliding operation on the first host information interface, interface 1402 is displayed. In interface 1402, the second layer completely blocks the host avatar area, and the avatar 142a of the target host account is displayed in the second layer, and the live content of the target host account is displayed on the avatar of the target host account.

[0134] S1207. Display the live content of the target anchor account in the anchor avatar area.

[0135] It should be understood that when the viewer client switches the live interface to the target interface or overlays and displays the target interface on the live interface, it can obtain the target area coordinates from the target encoded data stream, and then can add the above-mentioned playback layer on the anchor avatar area. Further, the viewer client can obtain the anchor avatar area coordinates of the anchor avatar area in the target interface, and based on the preset area coordinates and the anchor avatar area coordinates, determine the scaling ratio, and then can perform scaling processing on the playback video screen corresponding to the live data based on the scaling ratio to obtain a scaled playback video screen (i.e., the above-mentioned scaled video screen). Further, the viewer client can perform cropping processing on the scaled playback video screen (i.e., the above-mentioned scaled video screen) based on the anchor avatar area coordinates to obtain a cropped playback video screen, so that the cropped playback video screen can be played through a player on the playback view corresponding to the anchor avatar area, and the cropped playback video screen is the live content of the target anchor account displayed on the anchor avatar area.

[0136] It should be understood that optionally, since the anchor area coordinates may change during the live broadcast as the person in the live data processing screen moves, the server can, after detecting the change in the anchor area coordinates, use the changed anchor area coordinates as a new SEI, encode them together with the live data stream of the target anchor account to obtain a second encoded data stream, and send it to the viewer client, so that the viewer client can re-determine the scaling ratio based on the new SEI, so that subsequently, based on the re-determined scaling ratio, a new scaled video screen can be obtained, and then cropping processing can be performed on the new scaled video screen, and then the live content of the target anchor account displayed on the anchor avatar area can be updated by the newly obtained cropped playback video screen.

[0137] Optionally, the preset area coordinates can also be obtained by the server taking a screenshot of the live data processing screen corresponding to the live data of the target anchor account based on the preset key event and the key coordinates of the screen. Specifically, the server can detect the live content corresponding to the live data of the target anchor account. If it detects that a preset key event occurs, it intercepts the coordinates of the occurrence area of the preset key event in the live processing screen corresponding to the live data according to the key coordinates of the screen, and uses the coordinates of the occurrence area of the preset key event as the preset area coordinates. Among them, different types of live data can correspond to different preset key events, and one type of live data can correspond to multiple preset key events. These multiple preset key events can have different weights, that is, in a live data, if multiple preset key events are detected to occur at the same time, the coordinates of the occurrence area of the preset key event with the largest weight can be intercepted as the preset area coordinates. Exemplarily, the preset key events corresponding to the game type (that is, the type of live data with the content of e-sports games) can be one-on-one battle events and multi-player battle events that occur in the game, where the weight of the multi-player battle event can be greater than that of the one-on-one battle event; the preset key events corresponding to the goods-selling room type (that is, the type of live data with the content of introducing and recommending goods) can be goods display events. In this embodiment, after receiving the access request for the live content of the target anchor account sent by the viewer client, the server can use artificial intelligence (AI) to detect the live data of the target anchor account in real time. Every preset time period or when it detects that a preset key event corresponding to the type of live data of the target anchor account occurs, it updates the previously sent preset area coordinates and sends the updated preset area coordinates to the viewer client until the viewer client sends a request not to receive the live content of the target anchor account, and this request not to receive the live content of the target anchor account indicates that the live content of the target anchor account will no longer be displayed on the terminal display interface of this viewer client.

[0138] Among them, the live broadcast interface is obtained by the server performing a screen scaling process on the screen size of the live broadcast data processing screen corresponding to the live broadcast content based on the screen display size of the terminal where the viewer client is located. The live broadcast content of the target anchor account displayed in the live broadcast interface of the target anchor account in the viewer client is the content corresponding to the live broadcast data of the target anchor account in the target encoded data stream. Displaying the live broadcast content of the target anchor account in the live broadcast interface of the target anchor account in the viewer client means decoding the live broadcast data of the target anchor account through the player in the viewer client and then playing the decoded content. When the interface is switched to the target interface, the scaling ratio determined by the media processing module in the viewer client (this scaling ratio is determined by the media processing module based on the regional coordinates of the anchor avatar area in the target interface and the target area coordinates) can be used to perform a scaling process on the playback video screen corresponding to the live broadcast data based on the scaling ratio to obtain a scaled playback video screen (i.e., the above-mentioned scaled video screen). Further, the viewer client can perform a cropping process on the scaled playback video screen (i.e., the above-mentioned scaled video screen) based on the anchor avatar area coordinates to obtain a cropped playback video screen, so that it can be on the playback view corresponding to the anchor avatar area. In step S1206, in response to a sliding operation on the target interface, a target small window is displayed in the target interface, and the live broadcast content of the target anchor account displayed in the target small window can also be played and displayed in the target small window (i.e., the small window view) in the manner of step S1207. The target small window can be moved and displayed in the interface.

[0139] The specific method for obtaining the live broadcast content of the target anchor account displayed in the anchor avatar area is as described in the specific implementation manner of step S203 above, and will not be elaborated here. Figure 2 as described in the specific implementation manner of step S203 above, and will not be elaborated here.

[0140] In an alternative embodiment, after the live broadcast content is displayed in the host avatar area on the target interface, in response to a data sliding operation on the live broadcast content, based on the sliding trajectory corresponding to the sliding operation, the pixel offset value of the sliding operation is determined. Based on the pixel offset value, the target area coordinates, and the live broadcast content, the live broadcast content is updated to obtain updated live broadcast content, and the updated live broadcast content is displayed in the host avatar area. The live broadcast content may include first live broadcast content and second live broadcast content. Specifically, the pixel offset value can be added to the preset area coordinates (i.e., the horizontal coordinate and the vertical coordinate are added correspondingly) to obtain the coordinates of the updated live broadcast content. Then, the updated live broadcast content is scaled according to the above scaling steps, and the updated live broadcast content is displayed in the host avatar area. This allows the audience to control the screen area of the live broadcast content displayed in the host avatar area, thereby adding further interactivity for the audience and enhancing the audience experience while ensuring the continuity of the live broadcast and not obscuring the valid content in the current host information interface.

[0141] Based on the description of the related embodiments, an embodiment of the present application further provides a live broadcast display device, and the live broadcast display device can perform Figures 1 to 14 the operations shown. Please refer to Figure 15 as shown in Figure 15 which is a schematic diagram of a live broadcast display device provided by an embodiment of the present application. As Figure 15 shown, the live broadcast display device may include, but is not limited to, a display unit 1501.

[0142] The display unit 1501 is configured to display a live broadcast interface of a target host account, and the live broadcast content of the target host account is displayed on the live broadcast interface;

[0143] The display unit 1501 is further configured to, in response to a display operation on the target interface, display the target interface, where the target interface includes a host avatar area, and the host avatar area is used to display the avatar of the target host account;

[0144] The display unit 1501 is further configured to display the live broadcast content of the target host account in the host avatar area.

[0145] In one embodiment, the display unit 1501 is further configured to, in response to a sliding operation on the target interface, display a target small window in the target interface, and display the live broadcast content of the target host account through the target small window.

[0146] In one embodiment, the display unit 1501 is configured to, in response to a display operation on the target interface, display the target interface, including:

[0147] In response to the operation of displaying the host information, switch from the live broadcast interface to the target interface, where the target interface is the first host information interface of the target host account; or,

[0148] In response to the operation of querying the follow list, switch from the live broadcast interface to the target interface, where the target interface is the follow list interface; or,

[0149] In response to the operation of displaying the host information, superimpose and display the target interface on the live broadcast interface, where the target interface is the second host information interface of the target host account.

[0150] In one implementation, the target interface is the first host information interface of the target host account, and the first host information interface includes a first layer and a second layer, where the second layer is located above the first layer;

[0151] The display unit 1501 responds to the sliding operation on the target interface and displays a target small window in the target interface, including:

[0152] In response to the sliding operation on the first host information interface, slide the first layer;

[0153] In response to the host avatar area being partially or completely blocked during the sliding of the first layer, display the target small window in the first host information interface and display the avatar of the target host account in the second layer.

[0154] In one implementation, the live broadcast interface includes a host content display area; the device further includes an adjustment unit 1502:

[0155] The adjustment unit 1502 is further configured to, if the target interface is the second host information interface, respond to the size adjustment operation on the second host information interface and adjust the occlusion range of the second host information interface on the host content display area;

[0156] The display unit 1501 is further configured to respond to the occlusion range being less than a preset threshold, and redisplay the live broadcast content of the target host account in the host content display area and display the avatar of the target host account in the host avatar area.

[0157] In one implementation, the live broadcast interface includes an interface switching control;

[0158] The display unit 1501 is configured to respond to the display operation of the target interface and display the target interface, including:

[0159] In response to a control triggering operation on the interface switching control in the live broadcast interface, switch the display of the live broadcast interface to the target interface; the target interface includes any one of a follow list interface, a first host information interface, or a live broadcast recommendation interface.

[0160] In one implementation, the live broadcast interface is obtained by the server performing a screen scaling process on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target host account received.

[0161] The display unit 1501 is used to display the live content of the target host account in the host avatar area, including:

[0162] If the type of the live data is the first type, receive the first encoded data stream sent by the server for the live data, and obtain the live data and the preset area coordinates associated with the key coordinates of the screen from the first encoded data stream; the preset area coordinates are the coordinates of the center area of the screen in the live data processing screen, and the center area of the screen is determined by the server in the live data processing screen based on the first type and the key coordinates of the screen.

[0163] Perform data processing on the live data based on the preset area coordinates and the area coordinates of the host avatar area to obtain the live content of the target host account, and display the live content of the target host account in the host avatar area; the live content of the target host account is part of the data content in the live data.

[0164] In one implementation, the display unit 1501 is further used to, in response to a data sliding operation on the live content of the target host account, determine the pixel offset value of the sliding operation based on the sliding trajectory corresponding to the sliding operation; update the live content of the target host account based on the pixel offset value, the preset area coordinates, and the area coordinates of the host avatar area to obtain updated live content, and display the updated live content in the host avatar area.

[0165] In one embodiment, the live broadcast interface is obtained by the server performing screen scaling processing on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target anchor account received;

[0166] The display unit 1501 displays the live content of the target anchor account in the anchor avatar area, including:

[0167] If the type of the live data is the second type, receive the second encoded data stream sent by the server for the live data, and obtain the live data and the anchor area coordinates associated with the key coordinates of the screen from the second encoded data stream; the anchor area coordinates refer to the coordinates of the anchor area recognized by the server in the live data processing screen, and the anchor area is determined by the server based on the second type and the key coordinates of the screen to identify the people in the live data processing screen;

[0168] Based on the anchor area coordinates and the area coordinates of the anchor avatar area, perform data processing on the live data to obtain the live content of the target anchor account, and display the live content of the target anchor account in the anchor avatar area; the live content of the target anchor account is the part of the data content corresponding to the anchor in the live data.

[0169] The embodiment of the present application also provides a computer device, please refer to Figure 16 , Figure 16 is a schematic structural diagram of a computer device provided by the embodiment of the present application. As Figure 16 shown, the terminal device at least includes a processor 1601, a memory 1602, and a communication interface 1603, which can be connected through a bus 1604 or other means. In the embodiment of the present application, taking the connection through the bus 1604 as an example. The processor 1601 of the embodiment of the present application can execute the operations in the foregoing live broadcast display method by running the computer program stored in the memory 1602, for example:

[0170] Display the live broadcast interface of the target anchor account, and the live broadcast interface displays the live content of the target anchor account;

[0171] In response to the display operation of the target interface, display the target interface, and the target interface includes an anchor avatar area, and the anchor avatar area is used to display the avatar of the target anchor account;

[0172] Display the live content of the target anchor account in the anchor avatar area.

[0173] In an alternative embodiment, the processor 1601 further performs the following operations:

[0174] In response to a sliding operation on the target interface, a target small window is displayed in the target interface, and the live content of the target anchor account is displayed through the target small window.

[0175] In one embodiment, in response to a display operation of the target interface, when displaying the target interface, the processor 1601 specifically performs the following operations:

[0176] In response to an anchor information display operation, switch from the live interface to the target interface, where the target interface is the first anchor information interface of the target anchor account; or,

[0177] In response to a follow list query operation, switch from the live interface to the target interface, where the target interface is the follow list interface; or,

[0178] In response to an anchor information display operation, superimpose and display the target interface on the live interface, where the target interface is the second anchor information interface of the target anchor account.

[0179] In one embodiment, the target interface is the first anchor information interface of the target anchor account, and the first anchor information interface includes a first layer and a second layer, where the second layer is located above the first layer;

[0180] For the operation of displaying a target small window in the target interface in response to a sliding operation on the target interface, the processor 1601 specifically performs the following operations:

[0181] In response to a sliding operation on the first anchor information interface, slide the first layer;

[0182] In response to the anchor avatar area being partially or completely blocked during the sliding of the first layer, display a target small window in the first anchor information interface and display the avatar of the target anchor account in the second layer.

[0183] In one embodiment, the live interface includes an anchor content display area; the processor 1601 is further configured to perform the following operations:

[0184] If the target interface is the second anchor information interface, then in response to a size adjustment operation on the second anchor information interface, adjust the occlusion range of the second anchor information interface on the anchor content display area;

[0185] In response to the occlusion range being less than a preset threshold, the live content of the target anchor account is redisplayed in the anchor content display area, and the avatar of the target anchor account is displayed in the anchor avatar area.

[0186] In one implementation, the live interface includes an interface switching control;

[0187] In response to a display operation of a target interface, when displaying the target interface, the processor 1601 specifically performs the following operations:

[0188] In response to a control trigger operation on the interface switching control in the live interface, the live interface is switched to display the target interface; the target interface includes any one of a follow list interface, a first anchor information interface, or a live recommendation interface.

[0189] In one implementation, the live interface is obtained by the server performing a screen scaling process on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target anchor account received;

[0190] When displaying the live content of the target anchor account in the anchor avatar area, the processor 1601 specifically performs the following operations:

[0191] If the type of the live data is the first type, receive the first encoded data stream sent by the server for the live data, and obtain the live data and preset area coordinates associated with the key coordinates of the screen from the first encoded data stream; the preset area coordinates are the coordinates of the central area of the screen in the live data processing screen, and the central area of the screen is determined by the server in the live data processing screen based on the first type and the key coordinates of the screen;

[0192] Based on the preset area coordinates and the area coordinates of the anchor avatar area, perform data processing on the live data to obtain the live content of the target anchor account, and display the live content of the target anchor account in the anchor avatar area; the live content of the target anchor account is part of the data content in the live data.

[0193] In one implementation, the processor 1601 also performs the following operations:

[0194] In response to a data sliding operation on the live content of the target anchor account, based on the sliding trajectory corresponding to the sliding operation, determine the pixel offset value of the sliding operation;

[0195] Based on the pixel offset value, the preset area coordinates, and the area coordinates of the anchor avatar area, update the live content of the target anchor account to obtain updated live content, and display the updated live content in the anchor avatar area.

[0196] In one implementation, the live broadcast interface is obtained by the server performing screen scaling processing on the screen size of the live data processing screen corresponding to the live data based on the screen display size of the terminal where the viewer client is located; the screen size of the live data processing screen is determined by the server based on the key coordinates of the live data processing screen, and the live data is determined by the server based on the live data stream uploaded by the target anchor account received;

[0197] When displaying the live content of the target anchor account in the anchor avatar area, the processor 1601 specifically performs the following operations:

[0198] If the type of the live data is the second type, receive the second encoded data stream sent by the server for the live data, and obtain the live data and the anchor area coordinates associated with the key coordinates of the screen from the second encoded data stream; the anchor area coordinates refer to the coordinates of the anchor area recognized by the server in the live data processing screen, and the anchor area is determined by the server based on the second type and the key coordinates of the screen to identify the people in the live data processing screen;

[0199] Based on the anchor area coordinates and the area coordinates of the anchor avatar area, perform data processing on the live data to obtain the live content of the target anchor account, and display the live content of the target anchor account in the anchor avatar area; the live content of the target anchor account is the partial data content corresponding to the anchor in the live data.

[0200] This application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0201] This application embodiment also provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer is caused to execute the steps in any of the above method embodiments.

[0202] The embodiment of the present application further provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device installed with the chip executes the steps in any of the above method embodiments.

[0203] The steps in the method embodiments of the present application can be adjusted, combined, and deleted according to actual needs.

[0204] The units in the device embodiments of the present application can be combined, divided, and deleted according to actual needs.

Claims

1. A live broadcast display method, characterized in that: include: Displaying a live broadcast interface of a target anchor account, wherein the live broadcast interface displays the live broadcast content of the target anchor account; In response to a display operation of a target interface, leaving the live broadcast interface and entering the target interface, the target interface includes an anchor information area, and the anchor information area is used to display an avatar of the target anchor account; Displaying the live broadcast content of the target anchor account in the anchor information area, wherein the live broadcast content is embedded in the anchor information area; In the process of browsing the target interface by sliding the target interface, a target small window is displayed in the target interface, and the live broadcast content of the target anchor account is displayed through the target small window, wherein the target small window is displayed in a floating manner on the target interface.

2. The method according to claim 1, characterized in that The step of leaving the live broadcast interface and entering the target interface in response to the display operation of the target interface includes: In response to the anchor information display operation, switching from the live broadcast interface to the target interface, the target interface is the first anchor information interface of the target anchor account; or, In response to the watch list query operation, switching from the live broadcast interface to the target interface, the target interface being the watch list interface; or, In response to the anchor information display operation, the target interface is superimposed and displayed on the live broadcast interface, and the target interface is the second anchor information interface of the target anchor account.

3. The method according to claim 1, characterized in that: The target interface is a first anchor information interface of the target anchor account, wherein the first anchor information interface includes a first layer and a second layer, wherein the second layer is located above the first layer; The step of displaying a target small window in the target interface during browsing the target interface by sliding the target interface includes: In response to a sliding operation on the first anchor information interface, sliding the first layer; In response to the anchor information area being partially or completely blocked during the sliding of the first layer, a target small window is displayed on the first anchor information interface, and an avatar of the target anchor account is displayed on the second layer.

4. The method according to claim 2, characterized in that: The live broadcast interface includes an anchor content display area; The method further comprises: If the target interface is the second anchor information interface, in response to a size adjustment operation on the second anchor information interface, adjusting the blocking range of the second anchor information interface on the anchor content display area; In response to the occlusion range being smaller than a preset threshold, the live broadcast content of the target anchor account is re-displayed in the anchor content display area, and the avatar of the target anchor account is displayed in the anchor information area.

5. The method according to claim 1, characterized in that The live broadcast interface includes an interface switching control; The step of leaving the live broadcast interface and entering the target interface in response to the display operation of the target interface includes: In response to a control trigger operation on the interface switching control in the live broadcast interface, the live broadcast interface is switched and displayed as the target interface; the target interface includes any one of a follow list interface, a first anchor information interface, or a live broadcast recommendation interface.

6. The method according to claim 1, characterized in that The live broadcast interface is obtained by the server scaling the screen size of the live broadcast data processing screen corresponding to the live broadcast data based on the screen display size of the terminal where the viewer client is located; the screen size of the live broadcast data processing screen is determined by the server based on the screen key coordinates of the live broadcast data processing screen, and the live broadcast data is determined by the server based on the live broadcast data stream uploaded by the target anchor account received; The displaying the live broadcast content of the target anchor account in the anchor information area includes: If the type of the live data is the first type, a first coded data stream sent by the server for the live data is received, and the live data and the preset area coordinates associated with the screen key coordinates are obtained from the first coded data stream; the preset area coordinates are the coordinates of the screen center area in the live data processing screen, and the screen center area is determined by the server in the live data processing screen based on the first type and the screen key coordinates; Based on the preset area coordinates and the area coordinates of the anchor information area, the live broadcast data is processed to obtain the live broadcast content of the target anchor account, and the live broadcast content of the target anchor account is displayed in the anchor information area; the live broadcast content of the target anchor account is part of the data content in the live broadcast data.

7. The method according to claim 6, characterized in that The method further comprises: In response to a data sliding operation on the live broadcast content of the target anchor account, determining a pixel offset value of the sliding operation based on a sliding track corresponding to the sliding operation; Based on the pixel offset value, the preset area coordinates and the area coordinates of the anchor information area, the live broadcast content of the target anchor account is updated to obtain updated live broadcast content, and the updated live broadcast content is displayed in the anchor information area.

8. The method according to claim 1, characterized in that The live broadcast interface is obtained by the server scaling the screen size of the live broadcast data processing screen corresponding to the live broadcast data based on the screen display size of the terminal where the viewer client is located; the screen size of the live broadcast data processing screen is determined by the server based on the screen key coordinates of the live broadcast data processing screen, and the live broadcast data is determined by the server based on the live broadcast data stream uploaded by the target anchor account received; The displaying the live broadcast content of the target anchor account in the anchor information area includes: If the type of the live broadcast data is the second type, receiving a second coded data stream sent by the server for the live broadcast data, and acquiring the live broadcast data and the anchor area coordinates associated with the screen key coordinates from the second coded data stream; the anchor area coordinates refer to the coordinates of the anchor area identified by the server in the live broadcast data processing screen, and the anchor area is determined by the server identifying a person in the live broadcast data processing screen based on the second type and the screen key coordinates; Based on the anchor area coordinates and the area coordinates of the anchor information area, the live broadcast data is processed to obtain the live broadcast content of the target anchor account, and the live broadcast content of the target anchor account is displayed in the anchor information area; the live broadcast content of the target anchor account is part of the data content corresponding to the anchor in the live broadcast data.

9. A live broadcast display device, characterized in that: The device comprises: A display unit, used to display a live broadcast interface of a target anchor account, wherein the live broadcast interface displays the live broadcast content of the target anchor account; The display unit is further used to leave the live broadcast interface and enter the target interface in response to a display operation of the target interface, wherein the target interface includes an anchor information area, and the anchor information area is used to display the avatar of the target anchor account; The display unit is further used to display the live broadcast content of the target anchor account in the anchor information area, wherein the live broadcast content is embedded in the anchor information area; The display unit is also used to display a target small window in the target interface during browsing the target interface through a sliding operation on the target interface, and display the live broadcast content of the target anchor account through the target small window, wherein the target small window is displayed in a floating manner on the target interface.

10. A computer device, characterized in that: The computer device includes a memory, a communication interface and a processor, wherein the memory, the communication interface and the processor are interconnected; the memory stores a computer program, and the processor calls the computer program stored in the memory to implement the method described in any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

12. A computer program product, characterized in that The computer program product comprises a computer program adapted to be loaded by a processor and to execute the method according to any one of claims 1 to 8.

Images