Live broadcast interaction method and device, and storage medium

Abstract

The invention discloses a live broadcast interaction method and device and a storage medium, and relates to the technical field of computers. The method comprises the following steps: receiving a live video stream of an anchor user account; generating a live broadcast picture of the anchor user account based on the live broadcast video stream; obtaining display data of interactive content participated by the anchor user account in the live broadcast process, wherein the display data is used for generating an interactive picture synchronously displayed with the live broadcast picture; rendering and generating an interaction picture of the interaction content based on the display data; and displaying the live broadcast picture, and overlapping and displaying the interactive picture on the upper layer of the live broadcast picture. According to the method and the device, a video stream generation mode is adopted for the live broadcast picture of the anchor user account, and a data rendering generation mode is adopted for the interactive picture of the interactive content participated by the anchor user account, so that the rendering pressure of the client is reduced, the stream pushing cost of the server is reduced, the transmission speed of the live broadcast data is improved, and the user experience is improved. And therefore, the fluency and definition of the live broadcast picture can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to a live interaction method, device, and storage medium. Background Art

[0002] With the development of live technology, more and more people choose to live the game content of web games on live application programs.

[0003] In related technologies, for live streaming HTML5 games in a live application program, usually the display data required for displaying is separately loaded on the client side of the live application program to render an HTML5 web page. The HTML5 web page pulls a live video stream, which is a video stream including the live broadcast screen of the anchor. Then, the game content is presented on the web page written in HTML5 language.

[0004] However, the above method of loading the screen by HTML5 is limited by the rendering ability of the HTML5 web page, which may cause problems such as stuttering or blurring of the live broadcast screen. Summary of the Invention

[0005] Embodiments of this application provide a live interaction method, device, and storage medium. The technical solutions provided by the embodiments of this application are as follows:

[0006] According to one aspect of the embodiments of this application, a live interaction method is provided. The method includes:

[0007] Receiving a live video stream of an anchor user account;

[0008] Generating a live broadcast screen of the anchor user account based on the live video stream;

[0009] Obtaining display data of interaction content participated in by the anchor user account during the live broadcast, where the display data is used to generate an interaction screen that is synchronously displayed with the live broadcast screen;

[0010] Rendering and generating the interaction screen of the interaction content based on the display data;

[0011] Displaying the live broadcast screen and superimposing and displaying the interaction screen on the upper layer of the live broadcast screen.

[0012] According to one aspect of the embodiments of this application, a live interaction device is provided. The device includes:

[0013] A video stream receiving module, configured to receive a live video stream of an anchor user account;

[0014] A live broadcast screen generating module, configured to generate a live broadcast screen of the anchor user account based on the live video stream;

[0015] A display data acquisition module, configured to acquire display data of interaction content participated by the host user account during a live broadcast, where the display data is used to generate an interaction screen synchronously displayed with the live broadcast screen;

[0016] An interaction screen generation module, configured to render and generate the interaction screen of the interaction content based on the display data;

[0017] A screen display module, configured to display the live broadcast screen and superimpose and display the interaction screen on the upper layer of the live broadcast screen.

[0018] According to an aspect of an embodiment of the present application, a terminal device is provided. The terminal device includes a processor and a memory. A computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the above live broadcast interaction method.

[0019] According to an aspect of an embodiment of the present application, a computer-readable storage medium is provided. A computer program is stored in the computer-readable storage medium, and the computer program is loaded and executed by a processor to implement the above live broadcast interaction method.

[0020] According to an aspect of an embodiment of the present application, a computer program product is provided. The computer program product includes a computer program, and the computer program is loaded and executed by a processor to implement the above live broadcast interaction method.

[0021] The technical solution provided by the embodiment of the present application can bring the following beneficial effects:

[0022] By directly receiving the live video stream of the host user account, generating the live broadcast screen of the host user account, and acquiring the display data of the interaction content participated by the host user account during the live broadcast, rendering and generating the interaction screen of the interaction content, and then superimposing and displaying the interaction screen on the upper layer of the live broadcast screen. Compared with the related technology that loading the live video stream based on the display data is limited by the rendering ability of the HTML5 web page, the technical solution provided by the present application combines the advantages of generating a screen by the video stream and generating a screen by data rendering. The live broadcast screen of the host user account is generated by the video stream, and the interaction screen of the interaction content participated by the host user account is generated by data rendering, reducing the rendering pressure of the client, reducing the push stream cost of the server, and improving the transmission speed of the live broadcast data, thereby helping to improve the smoothness and clarity of the live broadcast screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a schematic diagram of the implementation environment of the solution provided by an embodiment of the present application;

[0024] Figure 2It is a flowchart of a live interaction method provided by an embodiment of the present application;

[0025] Figure 3 It is a schematic diagram of the live broadcast screen of the host user account provided by an embodiment of the present application;

[0026] Figure 4 It is a schematic diagram of the interaction screen of the interaction content provided by an embodiment of the present application;

[0027] Figure 5 It is a schematic diagram of the interaction content layer provided by an embodiment of the present application;

[0028] Figure 6 It is a schematic diagram of the interaction control layer provided by an embodiment of the present application;

[0029] Figure 7 It is a schematic diagram of each layer displayed on the live broadcast interface of the host user account provided by an embodiment of the present application;

[0030] Figure 8 It is a schematic diagram of the virtual item display layer provided by an embodiment of the present application;

[0031] Figure 9 It is a schematic diagram of each layer displayed on the live broadcast interface of the host user account provided by an embodiment of the present application;

[0032] Figure 10 It is a flowchart of a live interaction method provided by another embodiment of the present application;

[0033] Figure 11 It is a block diagram of a live interaction device provided by an embodiment of the present application;

[0034] Figure 12 It is a structural block diagram of a terminal device provided by an embodiment of the present application. Detailed implementation manners

[0035] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0036] Please refer to Figure 1 , which shows a schematic diagram of the solution implementation environment provided by an embodiment of the present application. This solution implementation environment can be implemented as a live interaction system. This solution implementation environment may include: a host terminal device 10, an audience terminal device 20, and a server 30.

[0037] The host terminal device 10 refers to the terminal device used by the host, and the viewer terminal device 20 refers to the terminal device used by the viewer. The host refers to the user participating in the live broadcast, and the viewer refers to the user watching the live broadcast participated by the host. The above host terminal device 10 and viewer terminal device 20 (collectively referred to as "terminal devices") can be electronic devices such as mobile phones, tablet computers, laptop computers, desktop computers, game consoles, e-book readers, multimedia playback devices, wearable devices, in-vehicle terminals, etc.

[0038] Regardless of the host terminal device 10 and the viewer terminal device 20, a target application program is running on each of them. The target application program is used to implement functions such as starting a live broadcast, watching a live broadcast, and participating in live broadcast interactions involved in this application. The type of the target application program is not limited in this application. Exemplarily, the target application program can be a live broadcast application program, a short video application program, a game application program, etc. Optionally, the target application program can be an application program that needs to be downloaded and installed, or an application program that can be used immediately upon clicking. This application does not make a limitation on this.

[0039] In addition, a camera is installed on the host terminal device 10, and the camera is used to collect the live broadcast image of the host terminal device 10.

[0040] The number of host terminal devices 10 can be one or more. Optionally, each host can start a solo live broadcast on the host terminal device 10, and then the host live broadcast image of one host is displayed in the live broadcast interface of the target application program. Optionally, each host can also start a joint live broadcast with other hosts on their respective host terminal devices 110, and then the host live broadcast images of multiple hosts are simultaneously displayed in the live broadcast interface of the target application program. The number of viewer terminal devices 20 can be one or more, and the viewer can select the live broadcast interface of the host they are interested in watching in the target application program.

[0041] The server 30 is used to provide background services for the clients of the target application installed and running on the host terminal device 10 and the viewer terminal device 20. For example, the server 30 may be the background server of the above-mentioned target application. The server 30 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, but is not limited thereto. Optionally, the server 30 may simultaneously provide background services for the target applications in multiple host terminal devices 10 and multiple viewer terminal devices 20. The host terminal device 10 and the viewer terminal device 20 may communicate with the server 30 through the network respectively.

[0042] In the embodiment of the present application, in the client of the target application installed and running on the viewer terminal device, a live video stream of the host user account is received, and based on the live video stream, a live video of the host user account is generated. Then, display data of the interactive content participated by the host user account during the live broadcast is obtained, and based on the display data, an interactive screen synchronized with the live video is rendered and generated. Finally, the live video is displayed as the underlying screen, and the interactive screen is superimposed and displayed on the upper layer of the live video.

[0043] Please refer to Figure 2 , which shows a flowchart of the live interactive method provided by an embodiment of the present application. The execution subject of each step of this method may be a terminal device, specifically referring to the above-mentioned viewer terminal device. This method may include at least one of the following steps 210 to 250:

[0044] Step 210, receiving a live video stream of the host user account.

[0045] The host user account is the user account held by the host. The host refers to the user participating in the live interaction. The host conducts a live broadcast on the host terminal device logged in with the host user account. When the host conducts a live broadcast, the host can choose to turn on the camera or not. The camera is used to collect the picture of the live video stream. Optionally, the camera may be the camera on the host terminal device, or the camera on other terminal devices, or the camera on an external camera device. The present application does not make any limitation thereto. When the camera is the camera on other terminal devices, the other terminal device is connected to the host terminal device through a network cable or wirelessly through the network. When the camera is the camera on an external camera device, the external camera device is connected to the host terminal device through a network cable.

[0046] When the host turns on the camera, the live video stream of the host user account refers to the continuous video frames captured by the camera during the host's live broadcast. When the host selects to enter the shooting scene of the camera, the live video stream of the host user account is the continuous video frames collected for the host's portrait. When the host selects not to enter the shooting scene of the camera, the live video stream of the host user account is the continuous video frames collected for any scene faced by the camera.

[0047] When the host does not turn on the camera, the live video stream of the host user account can be the video frames of the default configuration or the video frames customized by the host in advance. The video frames of the default configuration refer to a default image. Exemplarily, the default image can be any public image randomly selected from the network, or an image pre-selected by a technician, such as a selected landscape image, item image, person image, etc. The default image can also be a solid color image, such as a solid black image, a solid white image, etc. The video frames customized by the host in advance can be an image custom-selected by the host from the picture library or an image custom-drawn by the host at present. The custom-drawn image can be a pure text image or a painting image without text.

[0048] In the target application on the viewer terminal device logged in with the viewer user account, the viewer selects to enter the host's live broadcast room and view the host's live broadcast interface. Then the client of the target application will send a live broadcast viewing request to the server to request to view the host's live broadcast interface. The server sends the live video stream of the host user account to the client of the target application on the viewer terminal device, and then the client of the target application receives the live video stream of the host user account.

[0049] Step 220, generate the live broadcast picture of the host user account based on the live video stream.

[0050] The live broadcast picture of the host user account is the picture displayed in the live broadcast interface of the host user account.

[0051] In some embodiments, the picture content of the live broadcast picture is displayed in the live broadcast picture. The picture content of the live broadcast picture includes the account information of the host user account and the live broadcast picture of the host of the host user account.

[0052] The account information of the host user account includes at least one of the following: the account name of the host user account, the account avatar of the host user account, and the account popularity of the host user account.

[0053] The live broadcast screen of the host user account is a live broadcast screen generated based on the live video stream. When the host turns on the camera, the live broadcast screen of the host user account refers to the screen captured by the camera connected to the host's terminal device during the host's live broadcast. When the host selects to enter the shooting scene of the camera, the live broadcast screen of the host user account is a screen containing the host's portrait. When the host selects not to enter the shooting scene of the camera, the live broadcast screen of the host user account is a screen without the host's portrait. Then, based on the live video stream, the screen captured by the camera connected to the host's terminal device is continuously displayed in the live broadcast screen of the host user account. When the host does not turn on the camera, the live broadcast screen of the host user account can be the default image of the default configuration or the image customized by the host. Then, based on the live video stream, the default image or the image customized by the host is continuously displayed in the live broadcast screen of the host user account.

[0054] When the audience enters the host's live broadcast room, the audience's terminal device obtains the account information of the host user account and receives the live video stream of the host user account. Based on the live video stream of the host user account, the live broadcast screen of the host user account is generated. Based on the live broadcast screen of the host user account and the account information of the host user account, the live broadcast screen of the host user account is generated.

[0055] Optionally, the live broadcast interface of the host user account also includes the live broadcast information of the host user account and the live broadcast background screen of the host user account. Then, when the audience enters the host's live broadcast room, the audience's terminal device obtains the account information of the host user account, the live broadcast information of the host user account, and the live broadcast background screen of the host user account, and receives the live video stream of the host user account. Based on the live video stream of the host user account, the live broadcast screen of the host user account is generated. Based on the live broadcast screen of the host user account, the account information of the host user account, the live broadcast information of the host user account, and the live broadcast background screen of the host user account, the live broadcast screen of the host user account is generated.

[0056] The live broadcast information of the host user account is used to indicate the live broadcast situation of the live broadcast interface of the host user account. The live broadcast information of the host user account includes the number of viewers of the live broadcast interface, the viewers of the live broadcast interface, and the bullet screen information of the live broadcast interface. The live broadcast background image of the host user account is the background image of the live broadcast interface of the host user account, which is used to present the background for other content displayed in the live broadcast interface of the host user account to fill the display screen of the viewer's terminal device. The account information of the host user account, the host live broadcast image of the host user account, and the live broadcast information of the host user account are displayed in the live broadcast background image of the host user account. Optionally, the live broadcast background image of the host user account can be a default configured background image or an image customized by the host. Exemplarily, the live broadcast background image of the host user account can be a black background image or a white background image, etc.

[0057] It should be noted that when the screen size of the host live broadcast image of the host user account is the same as the screen size of the display screen of the viewer's terminal device, the live broadcast background image of the host user account may not be included in the live broadcast interface of the host user account, that is, it means that the host live broadcast image of the host user account can be directly used to fill the display screen of the viewer's terminal device, and the account information of the host user account and the live broadcast information of the host user account are displayed in the live broadcast interface of the host user account. When the screen size of the host live broadcast image of the host user account is smaller than the screen size of the display screen of the viewer's terminal device, the live broadcast background image of the host user account is included in the live broadcast interface of the host user account.

[0058] It should be noted that the screen size of the live broadcast image of the host user account is the same as the screen size of the display screen of the viewer's terminal device.

[0059] In addition, whether the live broadcast information of the host user account displayed in the live broadcast interface of the host user account is displayed in the live broadcast interface of the host user account can be set by the user himself. Exemplarily, when the viewer enters the host's live broadcast room, the viewer's terminal device will automatically pull the live broadcast information of the host user account and display the live broadcast information of the host user account in the live broadcast interface of the host user account. Then the viewer can choose to close the live broadcast information in the live broadcast interface, and the viewer's terminal device will stop obtaining the live broadcast information of the host user account, and the live broadcast information of the host user account will no longer be displayed in the live broadcast interface of the host user account.

[0060] The live broadcast image of the host user account can refer to Figure 3As shown, the live broadcast screen 300 of the host user account is displayed on the display screen of the viewer terminal device. In the live broadcast screen 300 of the host user account, the account information 301 of the host user account, the host live broadcast screen 302 of the host user account, the live broadcast information of the host user account, and the live broadcast background screen 304 of the host user account are displayed. As Figure 3 shown, the account information 301 of the host user account includes the account name of the host user account, the account avatar of the host user account, and the account popularity of the host user account. Since the screen size of the host live broadcast screen 302 of the host user account is smaller than the screen size of the display screen of the viewer terminal device, the live broadcast background screen 304 of the host user account is displayed in the live broadcast screen 300 of the host user account. The live broadcast information of the host user account includes the viewers 303 of the live broadcast interface and the bullet screen information 305 of the live broadcast interface.

[0061] By displaying the account information and the host live broadcast screen of the host user account in the live broadcast screen, the host information of this live broadcast can be seen in the live broadcast screen, which helps the viewers briefly understand the host and is conducive to increasing the viewers' attention to the host.

[0062] Step 230, obtain the display data of the interaction content participated by the host user account during the live broadcast. The display data is used to generate an interaction screen that is synchronously displayed with the live broadcast screen.

[0063] The interaction content participated by the host user account during the live broadcast is the content participated by the host user account when conducting a live broadcast on the host terminal device, and the viewers can participate in the interaction of this content on the viewer terminal device. For example, the viewers can boost, like, send gifts, leave messages, etc. for the host user account. The types of interaction content in this application are not limited, including but not limited to game content, chat content, sales content, and other interaction contents.

[0064] The display data of the interaction content is the data generated when the host user account participates in the interaction content on the host terminal device. The display data of the interaction content can be used to generate an interaction screen that is synchronously displayed with the live broadcast screen, or it can be understood that the display data of the interaction content is the rendering data required for the interaction screen.

[0065] Exemplarily, display data of the game content participated by the host user account during the live broadcast is obtained, and the display data is used to generate a game screen that is synchronously displayed with the live broadcast screen. Optionally, the game content can be a game on the web side or a game on the app side. In the case where the game content is a game on the web side, the display data of the interactive content is used to generate the web page where the game content is located, and to render and generate an interactive screen that is synchronously displayed with the live broadcast screen on the web page. In the case where the game content is a game on the app side, the display data of the interactive content is used to generate an interactive screen that is synchronously displayed with the live broadcast screen.

[0066] The terminal device used by the host user account to participate in the interactive content during the live broadcast can be the host terminal device or other terminal devices. In the case where the terminal device used by the host user account to participate in the interactive content during the live broadcast is other terminal devices, the other terminal devices are connected to the host terminal device through a network cable or wirelessly connected through a network. Exemplarily, if the interactive content is game content, the host can participate in the game on the host terminal device or on other terminal devices connected to the host terminal device. During the live broadcast of the host's participation in the game, the display data of the game content participated by the host user account during the live broadcast is obtained.

[0067] It should be noted that the data form of the display data obtained in step 230 is different from the data form of the live video stream obtained in step 210. The live video stream is multiple live video frames and can directly generate the live broadcast screen of the host user account, while the display data obtained in step 230 needs to be further rendered to generate the interactive screen of the interactive content.

[0068] Step 240: Based on the display data, render and generate an interactive screen of the interactive content.

[0069] The interactive screen of the interactive content is the screen displayed in the live broadcast interface of the host user account. Exemplarily, if the interactive content is game content, a game screen of the game content is rendered and generated based on the display data of the game content.

[0070] In some embodiments, the screen content of the interactive screen is displayed in the interactive screen, and the screen content of the interactive screen includes interactive content and interactive controls.

[0071] The interactive content is the content participated by the host user account during the live broadcast. For example, game content, chat content, sales content, etc. Exemplarily, if the interactive content is game content, the game content includes game characters, game scenes, game props, game skills, etc. The interactive control is used for the audience to trigger to realize the interaction with the interactive content participated by the host user account. The interactive controls include control buttons such as boost control buttons, like control buttons, and message control buttons.

[0072] It should be noted that the screen size of the interactive screen of the interactive content is the same as the screen size of the display screen of the viewer's terminal device.

[0073] Optionally, the interactive content and the interactive control may not overlap, that is, the picture area occupied by the interactive content on the display screen of the viewer's terminal device and the picture area occupied by the interactive control on the display screen of the viewer's terminal device may not overlap. Optionally, the interactive content and the interactive control may also overlap, that is, the picture area occupied by the interactive content on the display screen of the viewer's terminal device and the picture area occupied by the interactive control on the display screen of the viewer's terminal device overlap. For example, a part of the picture area occupied by the interactive content may be the same as a part of the picture area occupied by the interactive control. It is also possible that a part of the picture area occupied by the interactive content is the same as the entire picture area occupied by the interactive control, that is, the picture area occupied by the interactive control is a part of the picture area occupied by the interactive content, and the interactive control is displayed on the interactive content. It is also possible that the entire picture area occupied by the interactive content is the same as a part of the picture area occupied by the interactive control, that is, the picture area occupied by the interactive content is a part of the picture area occupied by the interactive control, and the interactive content is displayed on the interactive control.

[0074] Optionally, the screen size occupied by the interactive content may be the same as the screen size of the display screen of the viewer's terminal device, that is, the interactive content occupies the entire display area of the display screen of the viewer's terminal device. Optionally, the screen size occupied by the interactive content may also be smaller than the screen size of the display screen of the viewer's terminal device, that is, the interactive content occupies a part of the display area of the display screen of the viewer's terminal device. Usually, the interactive control will occupy a part of the display area of the display screen of the viewer's terminal device, rather than the entire display area of the display screen of the viewer's terminal device.

[0075] The interactive screen of the interactive content can be referred to Figure 4 As shown, the interactive content is game content, and the interactive screen is the game screen of the game content. In the interactive screen 400 of the interactive content, game characters 402, game characters 403, the health bars 401 of the game characters, and the interactive control 404 are displayed. The game character controlled by the host user account can be game character 402 or game character 403. For example, if the host user account controls game character 402 to participate in a game duel with game character 403, then the interactive content is the game duel content between game character 402 and game character 403, and the interactive screen of the interactive content is the game duel screen between game character 402 and game character 403.

[0076] Step 250, display the live broadcast screen and superimpose and display the interactive screen on the upper layer of the live broadcast screen.

[0077] The live video of the host user account is set as the bottom layer video, and the interactive video of the interactive content is set as the upper layer video of the live video of the host user account. Therefore, the live video of the host user account is displayed first, and the interactive video is superimposed and displayed on the upper layer of the live video. Thus, a combined video with the interactive video superimposed on the upper layer of the live video is displayed on the live interface of the host user account.

[0078] The technical solution provided by the embodiments of the present application directly receives the live video stream of the host user account to generate the live video of the host user account, obtains the display data of the interactive content participated by the host user account during the live broadcast, renders and generates the interactive video of the interactive content, and then superimposes and displays the interactive video on the upper layer of the live video. Compared with the related technology that loads the live video stream based on the display data and is limited by the rendering ability of the HTML5 web page, the technical solution provided by the present application combines the advantages of generating video by video stream and generating video by data rendering. The live video of the host user account is generated by video stream, and the interactive video of the interactive content participated by the host user account is generated by data rendering, reducing the rendering pressure on the client, reducing the push stream cost of the server, and improving the transmission speed of the live data, thereby helping to improve the smoothness and clarity of the live video.

[0079] When superimposing and displaying the interactive video on the upper layer of the live video, optionally, the video content of the interactive video and the video content of the live video may not overlap, that is, the video area occupied by the video content of the interactive video on the display screen of the viewer's terminal device does not overlap with the video area occupied by the video content of the live video on the display screen of the viewer's terminal device. Optionally, the video content of the interactive video and the video content of the live video may also overlap, that is, the video area occupied by the video content of the interactive video on the display screen of the viewer's terminal device overlaps with the video area occupied by the video content of the live video on the display screen of the viewer's terminal device. For example, a part of the video area occupied by the video content of the interactive video may be the same as a part of the video area occupied by the video content of the live video. It is also possible that the entire video area occupied by the video content of the interactive video is the same as a part of the video area occupied by the video content of the live video, that is, the video area occupied by the video content of the interactive video is a part of the video area occupied by the video content of the live video. It is also possible that a part of the video area occupied by the video content of the interactive video is the same as the entire video area occupied by the video content of the live video, that is, the video area occupied by the video content of the live video is a part of the video area occupied by the video content of the interactive video.

[0080] Due to the above-mentioned method of displaying the interactive screen by superimposing it on the upper layer of the live broadcast screen, it may cause the screen content in the interactive screen to partially or completely cover the screen content in the live broadcast screen, resulting in the audience being unable to see the entire screen content of the live broadcast screen, thus affecting the audience's live broadcast viewing experience. Therefore, it is necessary to process the interactive screen to avoid the problem of content occlusion.

[0081] In some embodiments, in the interactive screen, determine the display area corresponding to the live broadcast screen; perform processing on the display area to obtain the processed interactive screen, where the live broadcast screen is displayed through the display area of the processed interactive screen. Display the live broadcast screen and superimpose and display the processed interactive screen on the upper layer of the live broadcast screen.

[0082] Since the screen size of the live broadcast screen of the host user account and the screen size of the interactive screen of the interactive content are the same, both being the screen size of the display screen of the audience's terminal device, when superimposing and displaying the interactive screen on the upper layer of the live broadcast screen, the display area corresponding to the live broadcast screen can be directly determined in the interactive screen.

[0083] Determining the display area corresponding to the live broadcast screen in the interactive screen means determining the display area corresponding to the screen content of the live broadcast screen in the interactive screen. Exemplarily, determine the display area corresponding to the account information of the host user account and the display area corresponding to the host live broadcast screen of the host user account in the interactive screen. The display area corresponding to the live broadcast screen includes the display area corresponding to the account information of the host user account and the display area corresponding to the host live broadcast screen of the host user account.

[0084] Performing processing on the display area enables the screen content of the live broadcast screen to be displayed through the display area of the processed interactive screen, so that when the processed interactive screen is superimposed and displayed on the upper layer of the live broadcast screen, the screen content of the processed interactive screen will not occlude the screen content of the live broadcast screen, that is, the account information of the host user account and the host live broadcast screen in the live broadcast screen can be completely displayed on the live broadcast interface.

[0085] It should be noted that since the screen content of the live broadcast screen is completely displayed on the live broadcast interface of the host user account, it will synchronously cause a part of the screen content of the interactive screen corresponding to the display area to be occluded by the screen content of the live broadcast screen, which is inevitable.

[0086] By processing the display area corresponding to the live broadcast screen, the live broadcast screen can be displayed through the display area of the processed interactive screen, avoiding the live broadcast screen being set at the bottom layer, which may cause the screen content in the interactive screen to partially or completely cover the screen content in the live broadcast screen, allowing the audience to see the complete screen content of the live broadcast screen and enhancing the audience's live broadcast viewing experience.

[0087] In some embodiments, a display area is cut out from the interactive screen to obtain a processed interactive screen.

[0088] A hollowing process is performed on the display area in the interactive screen to remove the display area corresponding to the live broadcast screen in the interactive screen, obtaining a processed interactive screen. The processed interactive screen is not a complete interactive screen, but the corresponding screen area of the display area is cut out and does not exist. Therefore, the content of the live broadcast screen can be displayed through the cut-out screen area in the processed interactive screen.

[0089] In some embodiments, the transparency of the display area in the interactive screen is adjusted to full transparency to obtain a processed interactive screen.

[0090] The transparency of the display area in the interactive screen is adjusted to full transparency, and the transparency of other screen areas except the display area in the interactive screen is not adjusted, obtaining a processed interactive screen. The processed interactive screen is a complete interactive screen, where the corresponding screen area of the display area is fully transparent, and other screen areas except the display area normally display the screen content. Therefore, the content of the live broadcast screen can be displayed through the fully transparent screen area in the processed interactive screen.

[0091] By cutting out the display area in the interactive screen or adjusting the transparency of the display area in the interactive screen to full transparency, the processing of the display area in the interactive screen is realized, enabling the live broadcast screen to be displayed through the display area of the processed interactive screen, avoiding the content of the live broadcast screen being blocked by the content of the interactive screen, and improving the viewing experience of the audience for the live broadcast.

[0092] In some embodiments, in response to an adjustment operation for the display area corresponding to the live broadcast screen, in the interactive screen, the adjusted display area corresponding to the live broadcast screen is determined; the adjusted display area is processed to obtain a processed interactive screen.

[0093] The adjustment operation for the display area corresponding to the live broadcast screen is an operation performed by the audience to adjust the display area corresponding to the live broadcast screen. Optionally, the adjustment operation for the display area corresponding to the live broadcast screen can be an adjustment operation for the regional position of the display area corresponding to the live broadcast screen, or an adjustment operation for the regional size of the display area corresponding to the live broadcast screen.

[0094] When performing an adjustment operation on the regional position of the display area corresponding to the live broadcast screen, the viewer can separately adjust the regional position of the display area corresponding to the account information of the host user account and the regional position of the display area corresponding to the live broadcast screen of the host user account. For example, the viewer can press on the display area corresponding to the account information of the host user account or the display area corresponding to the live broadcast screen of the host user account with a finger or a mouse, drag the held display area, and move it to the regional position where the viewer wants to place it, thus completing the adjustment operation on the regional position of the display area corresponding to the live broadcast screen. Usually, the regional position of the display area corresponding to the account information of the host user account in the live broadcast screen is fixed. For example, it is usually displayed at the top of the live broadcast interface. Therefore, the adjustment operation on the regional position of the display area corresponding to the live broadcast screen can also be understood as the adjustment operation on the regional position of the display area corresponding to the live broadcast screen of the host user account. Therefore, usually, determining the adjusted display area corresponding to the live broadcast screen in the interactive screen can also be understood as determining the display area corresponding to the live broadcast screen of the host user account with the position adjusted in the interactive screen.

[0095] When performing an adjustment operation on the regional size of the display area corresponding to the live broadcast screen, the viewer can separately adjust the regional size of the display area corresponding to the account information of the host user account and the regional size of the display area corresponding to the live broadcast screen of the host user account. For example, the viewer can long-press on the display area corresponding to the account information of the host user account or the display area corresponding to the live broadcast screen of the host user account with a finger or a mouse to display the adjustment control for the regional size, and through the adjustment control for the regional size, adjust the regional size of the held display area, thus completing the adjustment operation on the regional size of the display area corresponding to the live broadcast screen. Usually, the regional size of the display area corresponding to the account information of the host user account in the live broadcast screen is fixed. Therefore, the adjustment operation on the regional size of the display area corresponding to the live broadcast screen can also be understood as the adjustment operation on the regional size of the display area corresponding to the live broadcast screen of the host user account. Therefore, usually, determining the adjusted display area corresponding to the live broadcast screen in the interactive screen can also be understood as determining the display area corresponding to the live broadcast screen of the host user account with the size adjusted in the interactive screen.

[0096] After the viewer performs an adjustment operation on the display area corresponding to the live broadcast screen, the display area corresponding to the live broadcast screen in the interactive screen has changed in position or size. According to the adjustment operation performed by the viewer on the display area corresponding to the live broadcast screen, the adjusted display area corresponding to the live broadcast screen is determined. In order to prevent the screen content of the live broadcast screen from being blocked by the screen content in the interactive screen again, it is necessary to reprocess the interactive screen.

[0097] Optionally, the adjusted display area corresponding to the live broadcast screen can be cropped from the interactive screen to obtain a processed interactive screen. Optionally, the transparency of the adjusted display area in the interactive screen can also be adjusted to full transparency to obtain a processed interactive screen.

[0098] After the viewer adjusts the regional position of the display area corresponding to the live broadcast screen, the interactive screen is processed accordingly based on the adjusted display area, so that the processed interactive screen is adjusted following the viewer's adjustment operation, avoiding the screen content of the live broadcast screen being blocked by the screen content of the interactive screen after the viewer adjusts the position, enriching the live broadcast function and enhancing the viewer's live broadcast viewing experience.

[0099] In some embodiments, the interactive screen includes an interactive content layer and an interactive control layer, and the display level of the interactive control layer is above the display level of the interactive content layer. Based on the interactive content data in the display data, the interactive content is rendered and generated; based on the interactive control data in the display data, the interactive control is rendered and generated; the interactive content is displayed in the interactive content layer, and the interactive control is displayed in the interactive control layer.

[0100] The display data of the interactive content participated by the host user account during the live broadcast includes interactive content data and interactive control data. The interactive content data is used to generate interactive content that is synchronously displayed with the live broadcast screen. The interactive content is the content participated by the host user account during the live broadcast, such as game content, chat content, sales content, etc. The interactive control data is used to generate interactive controls that are synchronously displayed with the interactive content. The interactive controls are used for the viewer to trigger to realize the interaction with the interactive content participated by the host user account. The interactive controls include control buttons such as boost control buttons, like control buttons, and message control buttons.

[0101] Based on the interactive content data in the display data, the interactive content is rendered and generated, and the interactive content is displayed in the interactive content layer. Based on the interactive control data in the display data, the interactive control is rendered and generated, and the interactive control is displayed in the interactive control layer.

[0102] For a schematic diagram of the interactive content layer, reference can be made to Figure 5 As shown, game content is displayed in the interactive content layer 500. The game content includes the health bar 501 of the game character, and game characters 502 and 503. For a schematic diagram of the interactive control layer, reference can be made to Figure 6 As shown, an interactive control 602 is displayed in the interactive control layer 600, as well as the control effect 601 displayed when the interactive control 602 is triggered.

[0103] Therefore, the above-mentioned step 250 is as follows: display the live broadcast screen, superimpose and display the interactive content layer on the upper layer of the live broadcast screen, and superimpose and display the interactive control layer on the upper layer of the interactive content layer. The schematic diagrams of each layer displayed on the live broadcast interface of the host user account can be referred to Figure 7 as shown. In the live broadcast interface of the host user account, the live broadcast screen layer 710, the interactive content layer 720, and the interactive control layer 730 are sequentially displayed. Among them, the display level of the live broadcast screen layer 710 is the first layer, that is, the bottom layer, the display level of the interactive content layer 720 is the second layer, that is, the interactive content layer 720 is the upper layer of the live broadcast screen layer 710, and the display level of the interactive control layer 730 is the third layer, that is, the interactive control layer 730 is the upper layer of the interactive content layer 720.

[0104] Since the interactive screen includes the interactive content layer and the interactive control layer, determining the display area corresponding to the live broadcast screen in the interactive screen means determining the display area corresponding to the live broadcast screen in the interactive content layer and the interactive control layer respectively, and then performing processing on the display area corresponding to the live broadcast screen in the interactive content layer to obtain the processed interactive content layer, and performing processing on the display area corresponding to the live broadcast screen in the interactive control layer to obtain the processed interactive control layer. Thus, the live broadcast screen is sequentially displayed through the display area of the processed interactive content layer and the display area of the processed interactive control layer. Optionally, the display area can be cut out in the interactive content layer to obtain the processed interactive content layer, and the display area can be cut out in the interactive control layer to obtain the processed interactive control layer; or the transparency of the display area in the interactive content layer can be adjusted to full transparency to obtain the processed interactive content layer, and the transparency of the display area in the interactive control layer can be adjusted to full transparency to obtain the processed interactive control layer; or the display area can be cut out in the interactive content layer to obtain the processed interactive content layer, and the transparency of the display area in the interactive control layer can be adjusted to full transparency to obtain the processed interactive control layer; or the transparency of the display area in the interactive content layer can be adjusted to full transparency to obtain the processed interactive content layer, and the display area can be cut out in the interactive control layer to obtain the processed interactive control layer.

[0105] By separately displaying the interactive content and interactive controls in the interactive screen on the interactive content layer and the interactive control layer, it is possible to avoid continuously obtaining interactive control data when the interactive control does not change, that is, there is no need to update the screen content of the interactive control layer, and only the interactive content data needs to be obtained to update the screen content of the interactive content layer, reducing the data transmission volume, reducing the rendering pressure on the client, and also reducing the server push stream cost, improving the transmission speed of the live broadcast data, and thus contributing to improving the smoothness and clarity of the live broadcast screen.

[0106] In some embodiments, the control effect triggered by the first user account is displayed on the interactive control layer; the control effect triggered by the second user account is displayed on the interactive content layer; wherein, the control effect is used to assist the host user account to participate in the interactive content.

[0107] The first user account is the user account currently held by the viewer, is the local user account, and is the user account logged in to the execution device (viewer terminal device) of the above live interactive method. The second user account is the user account held by other viewers, is a user account other than the local user account, and is the user account logged in to other terminal devices other than the above viewer terminal device.

[0108] In response to a trigger operation on the interactive control, the control effect of the interactive control is displayed on the interactive control layer. That is to say, when the local viewer clicks an interactive control on the viewer terminal device, the control effect of the clicked interactive control is displayed on the interactive control layer of the viewer terminal device held by the local viewer. If other viewers click an interactive control on their respective terminal devices, the control effect of the interactive control clicked by the other viewers is displayed on the interactive content layer of the viewer terminal device held by the local viewer. Exemplarily, User 1 clicks Interactive Control 1 on Terminal Device 1, and User 2 clicks Interactive Control 2 on Terminal Device 2. Then, the control effect of Interactive Control 1 is displayed on the interactive control layer of Terminal Device 1, and the control effect of Interactive Control 2 is displayed on the interactive content layer of Terminal Device 1. At the same time, the control effect of Interactive Control 2 is displayed on the interactive control layer of Terminal Device 2, and the control effect of Interactive Control 1 is displayed on the interactive content layer of Terminal Device 2.

[0109] The control effect can be related to the interactive control. For example, if the interactive control is a boosting control, the control effect of the boosting control can be a fireworks animation. If the interactive control is a like control, the control effect of the like control can be a heart animation. If the interactive control is a message control, the control effect of the message control can be an animation of the message text. The control effect can also be related to the interactive content. For example, if the interactive content is game content and the interactive control is a boosting control, the control effect of the boosting control can be a control effect of increasing the blood volume of the game character controlled by the host user account, or a control effect of treating the game character controlled by the host user account, and so on.

[0110] By displaying the control effect triggered by the local user account on the interactive control layer, the control effect triggered by the local user account is displayed more prominently. And by displaying the control effect of other user accounts on the interactive content layer, it is avoided that the control effect of other user accounts covers the control effect triggered by the local user account, highlighting the control effect triggered by the local user account and enhancing the live interactive experience of the viewer.

[0111] In some embodiments, a virtual item display layer is further included between the interactive content layer and the interactive control layer. The virtual item display layer is used to display virtual items received by the host user account during the live broadcast.

[0112] Virtual items are items with a gift nature. For example, virtual items can be virtual flowers, virtual stars, virtual lollipops, virtual cakes, virtual rings, virtual airplanes, virtual rockets, etc. The virtual item display layer is used to display virtual items sent by the viewer user account to the host user account during the live broadcast, and specifically used to display the virtual item display screen.

[0113] For a schematic diagram of the virtual item display layer, reference can be made to Figure 8 As shown, a virtual item 801 is displayed in the virtual item display layer 800. Here, the virtual item 801 is a virtual flower.

[0114] In the case where a virtual item display layer is included between the interactive content layer and the interactive control layer, the above step 250 is: display the live broadcast screen, superimpose and display the interactive content layer on the upper layer of the live broadcast screen, and superimpose and display the virtual item display layer on the upper layer of the interactive content layer, and superimpose and display the interactive control layer on the upper layer of the virtual item display layer. For a schematic diagram of each layer displayed on the live broadcast interface of the host user account, reference can be made to Figure 9 As shown, the live broadcast screen layer 910, the interactive content layer 920, the virtual item display layer 930, and the interactive control layer 930 are sequentially displayed on the live broadcast interface of the host user account. Among them, the display level of the live broadcast screen layer 910 is the first layer, that is, the bottom layer. The display level of the interactive content layer 920 is the second layer, that is, the interactive content layer 920 is the upper layer of the live broadcast screen layer 910. The display level of the virtual item display layer 930 is the third layer, that is, the virtual item display layer 930 is the upper layer of the interactive content layer 920. The display level of the interactive control layer 940 is the fourth layer, that is, the interactive control layer 940 is the upper layer of the virtual item display layer 930.

[0115] When there is a virtual item display layer between the interactive content layer and the interactive control layer, determining the display area corresponding to the live video in the interactive screen means determining the display areas corresponding to the live video in the interactive content layer, the virtual item display layer, and the interactive control layer respectively, and then performing processing on the display area corresponding to the live video in the interactive content layer to obtain the processed interactive content layer, performing processing on the display area corresponding to the live video in the virtual item display layer to obtain the processed virtual item display layer, and performing processing on the display area corresponding to the live video in the interactive control layer to obtain the processed interactive control layer. Thus, the live video is displayed successively through the display area of the processed interactive content layer, the display area of the processed virtual item display layer, and the display area of the processed interactive control layer. Optionally, the display area can be cut out from each display layer in the interactive content layer, the virtual item display layer, and the interactive control layer to obtain the processed display layer. Optionally, the transparency of the display area in each display layer of the interactive content layer, the virtual item display layer, and the interactive control layer can also be adjusted to full transparency to obtain the processed display layer. Optionally, the display area can be cut out from a part of the display layers in the interactive content layer, the virtual item display layer, and the interactive control layer to obtain a part of the processed display layer, and the transparency of the display area in another part of the display layers in the interactive content layer, the virtual item display layer, and the interactive control layer can be adjusted to full transparency to obtain another part of the processed display layer.

[0116] By inserting a virtual item display layer between the interactive content layer and the interactive control layer, it is possible to prevent virtual items from being displayed on the interactive content layer and causing a conflict effect with the interactive content, or being displayed on the interactive control layer and causing a conflict effect with the interactive control, ensuring the independence of the content displayed on each display layer and improving the display effect of the live interface.

[0117] In some embodiments, the above steps further include step 260, and step 260 includes at least one of sub-steps 261 to 263.

[0118] Sub-step 261: Receive an item video stream, which is used to display the virtual items received by the host user account.

[0119] The item video stream is a continuous video frame corresponding to the display animation of the virtual items received by the host user account. After the viewer user account sends a virtual item to the host user account during the live broadcast, the viewer terminal device receives the indication information of the virtual item, and then obtains the item video stream corresponding to the virtual item according to the indication information of the virtual item.

[0120] Sub-step 262: Generate a virtual item display screen based on the item video stream.

[0121] Generate a virtual item display screen based on consecutive video frames corresponding to the display animation of the virtual item. The virtual item display screen displays the virtual item.

[0122] In some embodiments, based on the item video stream, obtain the initial display screen corresponding to the item video stream; perform matte processing on the initial display screen according to pre-configured animation parameters to generate a virtual item display screen; wherein, the animation parameters include at least one of the following: the transparency of the virtual item display screen, the contrast of the virtual item display screen, the brightness of the virtual item display screen, the sharpening parameter of the virtual item display screen, and the noise reduction parameter of the virtual item display screen.

[0123] The initial display screen corresponding to the item video stream is a display screen directly generated based on the item video stream. Matte processing is used to adjust the visibility of the initial display screen, hide or display specific screens in the initial display screen, so that the screen content of the initial display screen and the screen content of other display layers can be naturally integrated together, avoiding color or content conflicts when the screen contents of different display layers are displayed, and improving the display effect of the screen.

[0124] The pre-configured animation parameters are animation parameters obtained by technicians through testing, and are used to make the virtual item display screen match different interactive contents and different terminal devices as much as possible, achieving a live broadcast effect suitable for most audiences.

[0125] Sub-step 263, in the virtual item display layer, display the virtual item display screen.

[0126] After receiving the item video stream as described above, generate a virtual item display screen and display the virtual item display screen in the virtual item display layer, so that the virtual item display screen can be displayed between the interactive content layer and the interactive control layer, improving the display level and display effect of the live broadcast screen.

[0127] Please refer to Figure 10 , which shows a flowchart of a live broadcast interaction method provided by another embodiment of the present application. The execution subject of each step of this method can be a terminal device, specifically referring to the audience terminal device mentioned above. This method may include at least one of the following steps 1010 to 1070:

[0128] Step 1010, receive the live video stream of the host user account.

[0129] Step 1020, generate a live broadcast screen of the host user account based on the live video stream.

[0130] Step 1030, receive the live video stream of the co-host user account.

[0131] A co-broadcasting user account is a user account of another host who participates in the interactive content together with the host user account during the live broadcast, and the live broadcast process is realized by the joint participation of the host user account and the co-broadcasting user account. Exemplarily, if the interactive content is game content, the game content is the game content in which the game character controlled by the host user account and the game character controlled by the co-broadcasting user account participate together. For example, it can be the game content in which the game character controlled by the host user account and the game character controlled by the co-broadcasting user account have a duel. As Figure 4 shown, the game character 402 can be the game character controlled by the host user account, the game character 403 can be the game character controlled by the co-broadcasting user account, and the interactive screen 400 shows the game content in which the game character 402 and the game character 403 have a duel.

[0132] When the co-broadcasting user (another host) conducts a live broadcast, they can choose to turn on the camera or not. When the co-broadcasting user turns on the camera, the live video stream of the co-broadcasting user account refers to the continuous video frames captured by the camera during the joint live broadcast of the co-broadcasting user and the host. When the co-broadcasting user chooses to enter the shooting scene of the camera, the live video stream of the co-broadcasting user account is the continuous video frames captured for the portrait of the co-broadcasting user. When the co-broadcasting user chooses not to enter the shooting scene of the camera, the live video stream of the co-broadcasting user account is the continuous video frames captured for any scene faced by the camera. When the co-broadcasting user does not turn on the camera, the live video stream of the co-broadcasting user account can be the video frames of the default configuration or the video frames pre-customized by the co-broadcasting user. The video frames of the default configuration refer to a default image. Exemplarily, the default image can be any publicly available image randomly selected from the network, or it can be an image pre-selected by technicians, such as a selected landscape image, item image, person image, etc. The default image can also be a solid color image, such as a full black image, a full white image, etc. The video frames pre-customized by the co-broadcasting user can be an image custom-selected by the co-broadcasting user from the picture library, or an image custom-drawn by the co-broadcasting user at present. The custom-drawn image can be a pure text image or a painting image without text.

[0133] After the audience enters the live broadcast room of the joint live broadcast of the host and the co-broadcasting user and watches the joint live broadcast interface of the host and the co-broadcasting user, the client of the target application will send a live broadcast viewing request to the server to request to watch the joint live broadcast interface of the host and the co-broadcasting user. The server sends the live video stream of the host user account and the live video stream of the co-broadcasting user account to the client of the target application on the audience terminal device, and then the client of the target application receives the live video stream of the host user account and the live video stream of the co-broadcasting user account.

[0134] Step 1040: Generate a live video of the co-host user account based on the second live video stream of the co-host user account.

[0135] The live video of the co-host user account is used to be displayed together with the live interface of the host user account in the combined live interface. The content of the live video of the co-host user account includes the account information of the co-host user account and the live video of the host of the co-host user account. The account information of the co-host user account includes at least one of the following: the account name of the co-host user account, the account avatar of the co-host user account, and the account popularity of the co-host user account.

[0136] The live video of the host of the co-host user account is a live video generated based on the live video stream of the co-host user account. When the co-host user turns on the camera, the live video of the host of the co-host user account refers to the video captured by the camera during the combined live broadcast of the host and the co-host user. Then, based on the live video stream of the co-host user account, the video captured by the camera is continuously displayed in the live video of the host of the co-host user account. When the co-host user does not turn on the camera, the live video of the host of the co-host user account can be the default image configured by default or the image customized by the co-host user. Then, based on the live video stream of the co-host user account, the default image is continuously displayed in the live video of the host of the co-host user account, or the image customized by the co-host user is displayed.

[0137] When a viewer enters the combined live broadcast room, the viewer's terminal device obtains the account information of the host user account and receives the live video stream of the host user account. Based on the live video stream of the host user account, the host live video of the host user account is generated. Based on the host live video of the host user account and the account information of the host user account, the live video of the host user account is generated. At the same time, the account information of the co-host user account is obtained, and the live video stream of the co-host user account is received. Based on the live video stream of the co-host user account, the host live video of the co-host user account is generated. Based on the host live video of the co-host user account and the account information of the co-host user account, the live video of the co-host user account is generated.

[0138] It should be noted that the screen size of the live video of the co-host user account is the same as the screen size of the display screen of the viewer's terminal device, but the screen size of the host live video of the co-host user account can be smaller than the screen size of the display screen of the viewer's terminal device.

[0139] Step 1050: Obtain the display data of the interaction content participated by the host user account and the co-host user account during the live broadcast. The display data is used to generate an interaction screen that is synchronously displayed with the live video.

[0140] Step 1060: Render an interactive screen for the interactive content based on the display data.

[0141] The interactive animation is used to display the interactive screen of the host user account and the interactive content participated by the co-host user account during the live broadcast.

[0142] Step 1070: Display the live broadcast screen and the live broadcast screen of the co-host user account, and superimpose and display the interactive animation on the upper layer of the live broadcast screen and the live broadcast screen of the co-host user account.

[0143] Optionally, the live broadcast screen of the host user account can be set as the bottom layer screen (the first layer screen), the live broadcast screen of the co-host user account can be set as the upper layer screen (the second layer screen) of the live broadcast screen of the host user account, and the interactive screen of the interactive content can be set as the upper layer screen (the third layer screen) of the live broadcast screen of the co-host user account. Then, in the joint live broadcast interface, the live broadcast screen of the host user account, the live broadcast screen of the co-host user account, and the interactive screen of the interactive content are displayed in sequence from bottom to top.

[0144] Optionally, the live broadcast screen of the co-host user account can also be set as the bottom layer screen (the first layer screen), the live broadcast screen of the host user account can be set as the upper layer screen (the second layer screen) of the live broadcast screen of the co-host user account, and the interactive screen of the interactive content can be set as the upper layer screen (the third layer screen) of the live broadcast screen of the host user account. Then, in the joint live broadcast interface, the live broadcast screen of the co-host user account, the live broadcast screen of the host user account, and the interactive screen of the interactive content are displayed in sequence from bottom to top.

[0145] In some embodiments, in the interactive screen, the display areas corresponding to the live video of the host user account and the display areas corresponding to the live video of the co-host user account are respectively determined, and processing is performed on the display areas corresponding to the live video of the host user account and the display areas corresponding to the live video of the co-host user account to obtain a processed interactive animation. The live video of the host user account and the live video of the co-host user account are displayed through the display areas of the processed interactive screen. Optionally, the display areas corresponding to the live video of the host user account and the display areas corresponding to the live video of the co-host user account can be cut out from the interactive screen to obtain a processed interactive screen. Optionally, the transparency of the display areas corresponding to the live video of the host user account and the transparency of the display areas corresponding to the live video of the co-host user account in the interactive screen can also be adjusted to full transparency to obtain a processed interactive screen. Optionally, the display areas corresponding to the live video of the host user account can be cut out from the interactive screen, and the transparency of the display areas corresponding to the live video of the co-host user account in the interactive screen can be adjusted to full transparency to obtain a processed interactive screen. Optionally, the display areas corresponding to the live video of the co-host user account can be cut out from the interactive screen, and the transparency of the display areas corresponding to the live video of the host user account in the interactive screen can be adjusted to full transparency to obtain a processed interactive screen.

[0146] By accessing the live video stream of the co-host user account, the interactive content in which the host user account and the co-host user account participate together during the joint live broadcast is realized, improving the diversity and richness of the live broadcast function, enabling the live broadcast interaction to meet the different live broadcast needs and interactive needs of the host and the audience, and improving the satisfaction of the host and the audience with the live broadcast interaction.

[0147] The following is an embodiment of the apparatus of the present application, which can be used to execute the method embodiment of the present application. For the details not disclosed in the embodiment of the apparatus of the present application, please refer to the method embodiment of the present application.

[0148] Please refer to Figure 11 , which shows a block diagram of a live broadcast interaction device provided by an embodiment of the present application. The device has the function of implementing the above-mentioned live broadcast interaction method, and the function can be implemented by hardware or by hardware executing corresponding software. The device can be the terminal device introduced above or can be set in the terminal device. As Figure 11 shown, the device 1100 may include: a video stream receiving module 1110, a live video generating module 1120, a display data obtaining module 1130, an interactive screen generating module 1140, and a screen display module 1150.

[0149] The video stream receiving module 1110 is used to receive the live video stream of the host user account.

[0150] The live screen generation module 1120 is used to generate the live screen of the anchor user account based on the live video stream.

[0151] The display data acquisition module 1130 is used to obtain the display data of the interactive content in which the anchor user account participates during the live broadcast process, and the display data is used to generate an interactive screen that is displayed synchronously with the live broadcast screen.

[0152] The interactive screen generation module 1140 is used to render and generate the interactive screen of the interactive content based on the display data.

[0153] The picture display module 1150 is used to display the live picture and to display the interactive picture in an overlay on the live picture.

[0154] In some embodiments, the apparatus 1100 further includes a picture processing module, wherein the picture processing module is configured to:

[0155] In the interactive screen, determining a display area corresponding to the live screen;

[0156] Processing is performed on the display area to obtain a processed interactive picture, wherein the live broadcast picture is displayed through the display area of the processed interactive picture.

[0157] The screen display module 1150 is used to:

[0158] The live broadcast screen is displayed, and the processed interactive screen is displayed on an upper layer of the live broadcast screen.

[0159] In some embodiments, the picture processing module is used to:

[0160] Eliminating the display area in the interactive picture to obtain the processed interactive picture;

[0161] or,

[0162] The transparency of the display area in the interactive picture is adjusted to be fully transparent to obtain the processed interactive picture.

[0163] In some embodiments, the picture processing module is used to:

[0164] In response to an adjustment operation on the display area corresponding to the live screen, determining, in the interactive screen, an adjusted display area corresponding to the live screen;

[0165] Processing is performed on the adjusted display area to obtain the processed interactive screen.

[0166] In some embodiments, the interactive screen includes an interactive content layer and an interactive control layer, and the display level of the interactive control layer is above the display level of the interactive content layer; the interactive screen generation module 1140 is configured to:

[0167] Render and generate the interactive content based on the interactive content data in the display data;

[0168] Render and generate the interactive control based on the interactive control data in the display data;

[0169] Display the interactive content in the interactive content layer and display the interactive control in the interactive control layer.

[0170] In some embodiments, a virtual item display layer is further included between the interactive content layer and the interactive control layer, and the virtual item display layer is used to display the virtual items received by the host user account during the live broadcast.

[0171] In some embodiments, the screen display module 1150 is configured to:

[0172] Receive an item video stream, where the item video stream is used to display the virtual items received by the host user account;

[0173] Generate a virtual item display screen based on the item video stream;

[0174] Display the virtual item display screen in the virtual item display layer.

[0175] In some embodiments, the screen display module 1150 is configured to:

[0176] Obtain an initial display screen corresponding to the item video stream based on the item video stream;

[0177] Perform matte processing on the initial display screen according to pre-configured animation parameters to generate the virtual item display screen;

[0178] Wherein, the animation parameters include at least one of the following: the transparency of the virtual item display screen, the contrast of the virtual item display screen, the brightness of the virtual item display screen, the sharpening parameter of the virtual item display screen, and the noise reduction parameter of the virtual item display screen.

[0179] In some embodiments, the screen display module 1150 is configured to:

[0180] Display the control effect of the first user account triggering the interactive control on the interactive control layer;

[0181] Display the control effect of the second user account triggering the interactive control on the interactive content layer;

[0182] Wherein, the control effect is used to assist the host user account to participate in the interactive content.

[0183] In some embodiments, the screen display module 1150 is configured to:

[0184] Receive the live video stream of the live user account;

[0185] Generate the live screen of the live user account based on the second live video stream of the live user account;

[0186] Display the live screen and the live screen of the live user account, and superimpose and display the interactive animation on the upper layer of the live screen and the live screen of the live user account;

[0187] Wherein, the interactive animation is used to display the interactive screen of the interactive content participated by the host user account and the live user account during the live broadcast.

[0188] In some embodiments, the live screen includes the account information of the host user account and the live broadcast screen of the host user account.

[0189] It should be noted that when the device provided in the above embodiments realizes its functions, only the above-mentioned division of each functional module is used for illustration. In actual application, the above functions can be allocated to different functional modules according to needs, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device provided in the above embodiments and the method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0190] Please refer to Figure 12 , which shows the structural block diagram of the terminal device 1200 provided in an embodiment of the present application. The terminal device 1200 can be any electronic device with data calculation, processing, and storage functions. The terminal device 1200 can be used to implement the live interaction method provided in the above embodiments.

[0191] Generally, the terminal device 1200 includes: a processor 1201 and a memory 1202.

[0192] The processor 1201 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. The processor 1201 may be implemented in at least one of the following hardware forms: DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1201 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1201 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1201 may further include an AI (Artificial Intelligence) processor, which is used to process computational operations related to machine learning.

[0193] The memory 1202 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 is used to store a computer program, and the computer program is configured to be executed by one or more processors to implement the above live interaction method.

[0194] Those skilled in the art can understand that Figure 12 the structure shown in does not constitute a limitation on the terminal device 1200, and it may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component layout.

[0195] In a schematic embodiment, a computer-readable storage medium is also provided. A computer program is stored in the storage medium, and the computer program, when executed by the processor of the terminal device, implements the above live interaction method. Optionally, the above computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0196] In an exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program stored in a computer-readable storage medium. A processor of the terminal device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the terminal device executes the above live interaction method.

[0197] It should be noted that before and during the process of collecting relevant data of the user, a prompt interface, a pop-up window or voice prompt information can be displayed. The prompt interface, pop-up window or voice prompt information is used to prompt the user that their relevant data is being collected currently, so that this application only starts to execute the relevant steps of obtaining the user's relevant data after obtaining the confirmation operation sent by the user for the prompt interface or the pop-up window. Otherwise (that is, when the confirmation operation sent by the user for the prompt interface or the pop-up window is not obtained), the relevant steps of obtaining the user's relevant data are ended, that is, the relevant data of the user is not obtained. In other words, all user data collected by this application is processed strictly in accordance with the requirements of relevant national laws and regulations. Obtaining the informed consent or separate consent of the personal information subject is carried out under the condition that the user agrees and authorizes, and subsequent data use and processing behaviors are carried out within the scope of laws and regulations and the authorization of the personal information subject, and the collection, use and processing of relevant user data need to comply with the relevant laws, regulations and standards of relevant countries and regions.

[0198] It should be understood that "a plurality of" mentioned herein refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. In addition, the step numbers described in this article only exemplarily show a possible execution sequence between steps. In some other embodiments, the above steps may not be executed in the order of the numbers. For example, two steps with different numbers are executed simultaneously, or two steps with different numbers are executed in the reverse order of the illustration. The embodiments of this application do not limit this.

[0199] The above are only exemplary embodiments of this application and are not intended to limit this application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of this application shall be included in the protection scope of this application.

Claims

1. A live interactive method, characterized in that, The method includes: Receiving a live video stream of the host user account; Generating a live video screen of the host user account based on the live video stream; Obtaining display data of interactive content participated in by the host user account during the live broadcast, where the display data is used to generate an interactive screen synchronously displayed with the live video screen; Rendering and generating the interactive screen of the interactive content based on the display data; Displaying the live video screen and superimposing and displaying the interactive screen on the upper layer of the live video screen.

2. The method according to claim 1, characterized in that The method further includes: Determining a display area corresponding to the live video screen in the interactive screen; Performing processing on the display area to obtain a processed interactive screen, where the live video screen is displayed through the display area of the processed interactive screen; The displaying the live video screen and superimposing and displaying the interactive screen on the upper layer of the live video screen includes: Displaying the live video screen and superimposing and displaying the processed interactive screen on the upper layer of the live video screen.

3. The method according to claim 2, wherein The performing processing on the display area to obtain a processed interactive screen includes: Cropping out the display area in the interactive screen to obtain the processed interactive screen; Or, Adjusting the transparency of the display area in the interactive screen to fully transparent to obtain the processed interactive screen.

4. The method according to claim 2 or 3, characterized in that The method further includes: In response to an adjustment operation for the display area corresponding to the live video screen, determining an adjusted display area corresponding to the live video screen in the interactive screen; Performing processing on the adjusted display area to obtain the processed interactive screen.

5. The method according to any one of claims 1 to 4, characterized in that, The interactive screen includes an interactive content layer and an interactive control layer, and the display level of the interactive control layer is above the display level of the interactive content layer; The rendering and generating the interactive screen of the interactive content based on the display data includes: Rendering and generating the interactive content based on the interactive content data in the display data; Rendering and generating the interactive control based on the interactive control data in the display data; Displaying the interactive content in the interactive content layer and displaying the interactive control in the interactive control layer.

6. The method according to claim 5, wherein A virtual item display layer is further included between the interactive content layer and the interactive control layer, and the virtual item display layer is used to display virtual items received by the host user account during the live broadcast.

7. The method according to claim 6, wherein The method further includes: Receiving an item video stream, where the item video stream is used to display the virtual items received by the host user account; Generating a virtual item display screen based on the item video stream; Displaying the virtual item display screen in the virtual item display layer.

8. The method according to claim 7, wherein The generating a virtual item display screen based on the item video stream includes: Obtaining an initial display screen corresponding to the item video stream based on the item video stream; Performing matte processing on the initial display screen according to pre-configured animation parameters to generate the virtual item display screen; Among them, the animation parameters include at least one of the following: the transparency of the virtual item display screen, the contrast of the virtual item display screen, the brightness of the virtual item display screen, the sharpening parameter of the virtual item display screen, and the noise reduction parameter of the virtual item display screen.

9. The method according to claim 5, characterized in that, The method further includes: Displaying the control effect of the first user account triggering the interactive control on the interactive control layer; Displaying the control effect of the second user account triggering the interactive control on the interactive content layer; Among them, the control effect is used to assist the host user account to participate in the interactive content.

10. The method according to any one of claims 1 to 9, characterized in that The method further includes: Receiving the live video stream of the co-host user account; Generating the live broadcast screen of the co-host user account based on the second live video stream of the co-host user account; Displaying the live broadcast screen and the live broadcast screen of the co-host user account, and superimposing and displaying the interactive animation on the upper layer of the live broadcast screen and the live broadcast screen of the co-host user account; Among them, the interactive animation is used to display the interactive screen of the interactive content participated by the host user account and the co-host user account during the live broadcast.

11. The method according to any one of claims 1 to 10, characterized in that, The live broadcast screen includes the account information of the host user account and the live broadcast screen of the host of the host user account.

12. A terminal device, characterized in that, The terminal device includes a processor and a memory, and a computer program is stored in the memory. The computer program is loaded and executed by the processor to implement the live broadcast interaction method according to any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium. The computer program is loaded and executed by the processor to implement the live broadcast interaction method according to any one of claims 1 to 11.

14. A computer program product, characterized in that, The computer program product includes a computer program. The computer program is loaded and executed by the processor to implement the live broadcast interaction method according to any one of claims 1 to 11.

Images