Live broadcast cover processing method and device, equipment, storage medium and program product

Abstract

The invention provides a live broadcast cover processing method and device, electronic equipment, a computer readable storage medium and a computer program product. The method comprises: displaying a live broadcast room; in response to a cover making operation for the live broadcast room, displaying a made cover material; in response to a sending operation for the cover material, an updating request carrying the cover material is sent to the anchor client, and the updating request is used for requesting the anchor client to confirm that the current live broadcast cover of the live broadcast room is updated to the cover material; and in response to a received confirmation message of the anchor client for the updating request, updating the current live broadcast cover of the live broadcast room into the cover material.

Description

Technical Field

[0001] The present application relates to Internet technologies, and in particular, to a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing a live broadcast cover image. Background Art

[0002] With the rapid development of social networks, more and more users tend to use social networks to enjoy rich and diverse entertainment content. Video live broadcast is a new social application. For a live broadcast host, a live broadcast room (corresponding to a live broadcast channel) can be opened, and the live broadcast video recorded in real time can be played through the live broadcast room; for an audience, they can enter a live broadcast room at will and watch the live broadcast video played by a certain host in real time.

[0003] In the related art, the home page of the live broadcast is filled with attractive live broadcast cover images. Many of these live broadcast cover images are set by the live broadcast hosts. These live broadcast cover images are usually irrelevant to the live broadcast content or lack attractiveness, seriously affecting the user viewing experience. Summary of the Invention

[0004] Embodiments of the present application provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing a live broadcast cover image, which can enrich the production methods of live broadcast cover images and promote interaction between the audience and the host.

[0005] The technical solution of the embodiments of the present application is implemented as follows:

[0006] Embodiments of the present application provide a method for processing a live broadcast cover image, which is applied to an audience client and includes:

[0007] Display a live broadcast room;

[0008] In response to a cover image production operation for the live broadcast room, display the produced cover image materials;

[0009] In response to a sending operation for the cover image materials, send an update request carrying the cover image materials to the host client, where the update request is used to request the host client to confirm to update the current live broadcast cover image of the live broadcast room to the cover image materials;

[0010] In response to receiving a confirmation message from the host client for the update request, update the current live broadcast cover image of the live broadcast room to the cover image materials.

[0011] Embodiments of the present application provide a method for processing a live broadcast cover image, which is applied to a host client and includes:

[0012] Display a live broadcast room;

[0013] In response to receiving an update request carrying cover material sent by the viewer client, display a prompt message for the update request, where the update request is used to request the host client to confirm updating the current live cover of the live room to the cover material;

[0014] In response to a confirmation operation for the prompt message, update the current live cover of the live room to the cover material.

[0015] An embodiment of the present application provides a live cover processing device, including:

[0016] A first display module, configured to display a live room;

[0017] A production module, configured to display the produced cover material in response to a cover production operation for the live room;

[0018] A sending module, configured to send an update request carrying the cover material to the host client in response to a sending operation for the cover material, where the update request is used to request the host client to confirm updating the current live cover of the live room to the cover material;

[0019] An update module, configured to update the current live cover of the live room to the cover material in response to receiving a confirmation message from the host client for the update request.

[0020] An embodiment of the present application provides a live cover processing device, including:

[0021] A second display module, configured to display a live room;

[0022] A prompt module, configured to display a prompt message for the update request in response to receiving an update request carrying cover material sent by the viewer client, where the update request is used to request the host client to confirm updating the current live cover of the live room to the cover material;

[0023] A determination module, configured to update the current live cover of the live room to the cover material in response to a confirmation operation for the prompt message.

[0024] An embodiment of the present application provides an electronic device, where the electronic device includes:

[0025] A memory, configured to store a computer program or computer executable instructions;

[0026] A processor, configured to implement the live cover processing method provided by the embodiment of the present application when executing the computer program or computer executable instructions stored in the memory.

[0027] An embodiment of the present application provides a computer-readable storage medium storing a computer program or computer-executable instructions. When the computer program or computer-executable instructions are executed by a processor, the live broadcast cover processing method provided by the embodiment of the present application is implemented.

[0028] An embodiment of the present application provides a computer program product including a computer program or computer-executable instructions. When the computer program or computer-executable instructions are executed by a processor, the live broadcast cover processing method provided by the embodiment of the present application is implemented.

[0029] The embodiment of the present application has the following beneficial effects:

[0030] The viewer client produces cover materials for the live broadcast room and sends an update request carrying the cover materials to the host client to request the host client to confirm updating the current live broadcast cover of the live broadcast room to the cover materials. When the host client confirms the update request, the current live broadcast cover of the live broadcast room is updated to the cover materials. In this way, viewers can produce live broadcast covers, enriching the production methods of live broadcast covers, promoting the interaction between viewers and hosts, and through viewers producing live broadcast covers, it can be ensured as much as possible that the content expressed by the produced live broadcast covers is consistent with the content of the live broadcast room, improving the authenticity of the live broadcast covers, and thus improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a schematic diagram of the architecture of the live broadcast system provided by the embodiment of the present application;

[0032] Figure 2A is a schematic diagram of the structure of the electronic device provided by the embodiment of the present application;

[0033] Figure 2B is a schematic diagram of the structure of the electronic device provided by the embodiment of the present application

[0034] Figure 3A is the first process schematic diagram of the live broadcast cover processing method provided by the embodiment of the present application;

[0035] Figure 3B is the second process schematic diagram of the live broadcast cover processing method provided by the embodiment of the present application;

[0036] Figure 4 is the process schematic diagram of the live broadcast cover processing method provided by the embodiment of the present application;

[0037] Figure 5 is the first schematic diagram of producing a live broadcast cover provided by the embodiment of the present application;

[0038] Figure 6 is the schematic diagram of the live broadcast home page provided by the embodiment of the present application;

[0039] Figure 7It is a schematic diagram of a live screenshot provided by an embodiment of the present application;

[0040] Figure 8 It is a schematic diagram of a cover update switch provided by an embodiment of the present application;

[0041] Figure 9 It is a schematic diagram of a message reminder box provided by an embodiment of the present application;

[0042] Figure 10 It is a notification interface provided by an embodiment of the present application;

[0043] Figure 11 It is a schematic diagram of label setting provided by an embodiment of the present application;

[0044] Figure 12A It is a first schematic diagram of a message reminder provided by an embodiment of the present application;

[0045] Figure 12B It is a second schematic diagram of a message reminder provided by an embodiment of the present application;

[0046] Figure 13 It is a live private message interface provided by an embodiment of the present application;

[0047] Figure 14 It is a schematic diagram of a solution for a live cover processing method provided by an embodiment of the present application;

[0048] Figure 15 It is a schematic diagram of index statistics for a live cover provided by an embodiment of the present application. Detailed implementation manners

[0049] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0050] In the following descriptions, the terms "first / second" are merely used to distinguish similar objects and do not represent a specific order for the objects. It can be understood that "first / second" can be interchanged with a specific order or sequence when allowed, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0051] In the following descriptions, reference is made to "some embodiments", which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0052] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of the overall module or unit that includes the function of that module or unit.

[0053] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0054] Before further elaborating on the embodiments of this application, the nouns and terms involved in the embodiments of this application are described. The nouns and terms involved in the embodiments of this application are subject to the following explanations.

[0055] 1) In response to: used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more executed operations can be real-time or can have a set delay; without special instructions, there is no limit on the execution order of the multiple executed operations.

[0056] 2) Client: An application program running on a terminal device for providing various services, such as a live broadcast client, a video client, etc.

[0057] 3) Live broadcast: The principles and processes of the host pushing the stream and the user watching the video involve real-time video transmission and network communication technologies. The following is the workflow of live broadcast: a) Host pushing the stream: The host uses devices such as cameras and microphones to obtain video signals and audio signals and encodes them into digital data. Then, this digital data is uploaded to the server through a push-streaming software or platform, such as OBS, YouTube, Twitch, etc., via the network; b) Server processing: After receiving the data pushed by the host, the server will decode and process the data. By decoding, the digital data is converted back into video signals and audio signals. Data processing includes video quality adjustment, audio enhancement, etc.; c) Viewer request: The user (i.e., the viewer) sends a request to the server through a browser, mobile application, or other client to request to watch the live broadcast. This request includes the user's device information, network bandwidth, etc.; d) Server response: Based on the content and device information of the user's request, the server selects an appropriate video encoding and transmission protocol and divides the video data into data packets; e) Data transmission: The server transmits the divided video data to the user device through the network. During this process, the data packets will pass through multiple network nodes, such as routers, switches, etc., and are transmitted to the network where the user is located through the Internet; f) User decoding: After receiving the video data, the user device will decode and process it. By decoding, the digital data is converted back into video and audio signals. Processing includes video rendering, audio playback, etc.; g) Video playback: The user device synthesizes the decoded video signals and audio signals and displays them to the user through devices such as monitors and speakers. The user can watch the live broadcast video and hear the sound in real time. Throughout the live broadcast process, the key technologies include video encoding, network transmission protocols, data compression and decompression, real-time transmission control, etc. The development and optimization of these technologies have made the experience of the host pushing the stream and the user watching the live broadcast smoother and of higher quality.

[0058] The embodiments of the present application provide a live broadcast cover processing method, device, electronic device, computer-readable storage medium, and computer program product, which can enrich the production methods of live broadcast covers and promote the interaction between viewers and hosts. The following describes the electronic device provided by the embodiments of the present application. The electronic device provided by the embodiments of the present application can be implemented as a terminal device or can be jointly implemented by a server and a terminal device. The following takes the case where the live broadcast cover processing method provided by the embodiments of the present application is jointly implemented by a server and a terminal device as an example for description.

[0059] See Figure 1 , Figure 1It is a schematic architecture diagram of the live broadcast system 100 provided by an embodiment of the present application. The terminal (exemplarily showing the terminal 200-1 and the terminal 200-2. The terminal 200-1 is a terminal device associated with the viewer, and the terminal 200-2 is a terminal device associated with the anchor) is connected to the server 100 through the network 300. Among them, the network 300 can be a wide area network or a local area network, or a combination of the two. The server 100 can be the background server of the live broadcast platform.

[0060] In some embodiments, the terminal 200-1 (running a live broadcast client, that is, a viewer client) displays the live broadcast room, responds to the cover production operation for the live broadcast room, displays the produced cover material, and responds to the sending operation for the cover material, and sends an update request carrying the cover material to the anchor client. Among them, the update request is used to request the anchor client to confirm to update the current live broadcast cover of the live broadcast room to the cover material. The terminal 200-2 (running a live broadcast client, that is, an anchor client) receives, through the server 100, the update request carrying the cover material sent by the viewer client, and displays a prompt message of the update request. Among them, the update request is used to request the anchor client to confirm to update the current live broadcast cover of the live broadcast room to the cover material; in response to the confirmation operation for the prompt message, the current live broadcast cover of the live broadcast room is updated to the cover material. In this way, the viewer can produce the live broadcast cover, enrich the production method of the live broadcast cover, promote the interaction between the viewer and the anchor, and through the viewer producing the live broadcast cover, it can be ensured as much as possible that the content expressed by the produced live broadcast cover is consistent with the content of the live broadcast room, improve the authenticity of the live broadcast cover, and thus improve the user experience.

[0061] In some embodiments, the terminal or the server can implement the live broadcast cover processing method provided by the embodiments of the present application by running various computer-executable instructions or computer programs. For example, the computer-executable instructions can be commands at the microprogram level, machine instructions, or software instructions. The computer program can be a native program or a software module in the operating system; it can be a local (Native) application program (APP, Application), that is, a program that needs to be installed in the operating system to run, such as a live broadcast application program; it can also be a small program embedded in any APP, that is, a program that only needs to be downloaded to the browser environment to run. All in all, the above computer-executable instructions can be instructions in any form, and the above computer programs can be application programs, modules, or plug-ins in any form.

[0062] In some embodiments, the server 100 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, Content Delivery Network (CDN), and big data and artificial intelligence platforms. Among them, the cloud service may be a live cover processing service for the terminal to call.

[0063] In some embodiments, the terminal provided in the embodiments of the present application may be implemented as various types of user terminals such as a laptop computer, a tablet computer, a desktop computer, a set-top box, a mobile device (for example, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable game device, a vehicle-mounted device), a smart phone, a smart speaker, a smart watch, a smart TV, a vehicle-mounted terminal, etc.

[0064] In some embodiments, multiple servers may form a blockchain, and the server 100 is a node on the blockchain. There may be an information connection between each node in the blockchain, and information can be transmitted between nodes through the above information connection. Among them, the data related to the live cover processing method provided in the embodiments of the present application (such as the logic of live cover processing, cover materials) can be stored on the blockchain.

[0065] The following describes the structure of the electronic device provided in the embodiments of the present application. Refer to Figure 2A , Figure 2A which is a schematic structural diagram of the electronic device 500 provided in the embodiments of the present application. Taking the electronic device 500 as the terminal 200-1 as an example for illustration, Figure 2A the illustrated electronic device 500 includes: at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 2A all kinds of buses are labeled as the bus system 540.

[0066] The processor 510 may be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a Digital Signal Processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or any conventional processor, etc.

[0067] The memory 550 includes volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM, Read Only Memory), and the volatile memory may be a random access memory (RAM, Random Access Memory). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory. Optionally, the memory 550 includes one or more storage devices that are physically remote from the processor 510.

[0068] In some embodiments, the memory 550 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which will be exemplarily described below.

[0069] The operating system 551 includes system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0070] The network communication module 552 is used to reach other electronic devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wi-Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;

[0071] In some embodiments, the live cover processing device provided by the embodiments of the present application can be implemented in software. The information processing device provided by the embodiments of the present application can be provided as various software embodiments, including various forms such as application programs, software, software modules, scripts, or code.

[0072] Figure 2A Shown is the live cover processing device 555 stored in the memory 550, which may be software in the form of programs and plugins, etc., and includes a series of modules, including a first display module 5551, a production module 5552, a sending module 5553, and an update module 5554. These modules are logical, so they can be combined arbitrarily or further split according to the functions to be implemented. The functions of each module will be described below.

[0073] See Figure 2B , Figure 2B is a schematic structural diagram of the electronic device 600 provided by the embodiments of the present application. Taking the electronic device 600 as the terminal 200-2 as an example for illustration, Figure 2BThe electronic device 600 shown includes: at least one processor 610, a memory 650, at least one network interface 620, and a user interface 630. Each component in the electronic device 600 is coupled together through a bus system 640. The memory 650 includes an operating system 651 and a network communication module 652. It should be noted that Figure 2B the function of the structure in Figure 2A is similar to the function of the structure in Figure 2B The live cover processing device 655 stored in the memory 650 is shown, which can be software in the form of a program and a plugin, etc., and includes the following software modules: a second display module 6551, a prompt module 6552, and a determination module 6553. These modules are logical, so they can be combined arbitrarily or further split according to the functions implemented.

[0074] As mentioned above, the live cover processing method provided by the embodiments of the present application can be implemented by various types of electronic devices, such as a terminal, a server, or a combination of both. Therefore, the execution subject of each step will not be repeated hereinafter. Refer to Figure 3A , Figure 3A which is a schematic flowchart of the live cover processing method provided by the embodiments of the present application. Figure 3A The live cover processing method shown is applied to the viewer client, and the following will be described in combination with Figure 3A the steps shown.

[0075] In step 101, the live broadcast room is displayed.

[0076] For example, after entering a certain anchor's live broadcast room through the live broadcast room entrance, the anchor's live broadcast room is displayed, that is, the anchor's screen is displayed. It should be noted that the current live cover may be displayed in the live broadcast room.

[0077] In some embodiments, before step 101, a live room list is displayed, where the live room list includes multiple candidate live room covers; at least one of the following processes is performed on the live room list: in response to a trigger operation on a sorting control, sorting the multiple candidate live room covers; in response to a trigger operation on a tag selection control, displaying multiple candidate tags, and in response to a selection operation on a candidate tag, hiding the candidate live room covers that do not match the selected candidate tag; in this regard, step 101 can be implemented in the following manner: in response to a trigger operation on a candidate live room cover, displaying the live room corresponding to the candidate live room cover. Among them, the candidate live room cover is the live cover of a candidate live room and can be used as the live room entrance to enter the candidate live room. For example, by triggering the candidate live room cover, one can enter the candidate live room. The candidate tag is used to identify the category of the candidate live room cover, that is, to identify the category of the candidate live room. For example, if the candidate tag is "singing", it means that the host in the candidate live room corresponding to this candidate tag is singing.

[0078] As an example, the tag selection control is described. When the tag selection control is triggered, it is used to filter the candidate live room covers based on the selected candidate tag, that is, only displaying the candidate live room covers that match the selected candidate tag and hiding the candidate live room covers that do not match the selected candidate tag. As Figure 6 shown, a live room list is displayed on the live home page. In response to a trigger operation on the tag selection control 601 on the live home page, multiple candidate tags are displayed, and in response to a selection operation on a candidate tag, the candidate live room covers that do not match the selected candidate tag are hidden, so that viewers can filter the candidate live room covers according to the selected candidate tag to quickly screen out the live room they want to enter.

[0079] As an example, the sorting control is described. When the sorting control is triggered, it is used to sort the candidate live room covers in a set sorting manner. The set sorting manner can be sorting by click-through rate, sorting by number of likes, sorting by average viewing duration, comprehensive sorting, etc. Different sorting controls can correspond to different sorting manners. As Figure 6 shown, a live room list is displayed on the live home page. In response to a trigger operation on the click-through rate sorting control 602 (i.e., the sorting control) on the live home page, the candidate live rooms displayed on the live home page are sorted according to the click-through rate of the candidate live room covers, so that viewers can quickly browse the candidate live room covers according to the click-through rate to quickly locate the live room they want to enter.

[0080] In step 102, in response to a cover production operation on the live room, the produced cover material is displayed.

[0081] Among them, the produced cover material is the live broadcast cover made by the audience (also known as the user) for the anchor to review whether it can replace the current live broadcast cover of the live broadcast room. The embodiments of the present application are not limited to the presentation form of the cover material. The cover material can be in the form of text, picture, animation, video, etc.

[0082] In some embodiments, step 102 can be implemented in the following manner: display at least one candidate material, where the type of at least one candidate material includes at least one of the following: text material, picture material, voice material, video material; in response to a cover production operation based on the candidate material, display the produced cover material, where the cover material is edited and formed based on at least one candidate material.

[0083] Such as Figure 5 shown, a cover production control 501 is displayed in the live broadcast room. In response to the trigger operation of the cover production control 501, at least one candidate material is displayed, and in response to a cover production operation based on the candidate material, the produced cover material is displayed. In this regard, the audience manually edits the candidate material to form a cover material that conforms to the creative ideas of the audience. Among them, the cover production operation includes all image editing operations, such as screenshot, zoom, flip, etc. operations, and can also add decorations, such as hats, glasses, etc. to enrich the cover production.

[0084] See Figure 3B , Figure 3B is a schematic flowchart of the live broadcast cover processing method provided by the embodiments of the present application, Figure 3B showing that step 102 can be implemented through steps 1021 - 1022: in step 1021, display at least one candidate material, where the type of at least one candidate material includes at least one of the following: text material, picture material, voice material, video material; in step 1022, in response to a selection operation for the candidate material, display the cover material automatically generated by the selected candidate material.

[0085] Such as Figure 5 shown, a cover production control 501 is displayed in the live broadcast room. In response to the trigger operation of the cover production control 501, at least one candidate material is displayed, and in response to a selection operation for the candidate material, the cover material automatically generated by the selected candidate material is displayed. In this regard, the candidate material is automatically edited to form a new cover material, thereby improving the cover editing efficiency.

[0086] In some embodiments, before displaying at least one candidate material, in response to a trigger operation for making a cover of a live streaming room, at least one source of cover materials is displayed, where the at least one source of cover materials includes: local materials of the viewer client, real-time live streaming images of the live streaming room, and historical live streaming images of the live streaming room; in response to a selection operation for the source of cover materials, the selected source of cover materials is used as the source of materials for the at least one candidate material.

[0087] Among them, the local materials of the viewer client refer to materials directly obtained from the local of the viewer client, such as pictures, animations, and videos in the local album of the viewer client. The real-time live streaming images of the live streaming room refer to live streaming images obtained in real time from the live streaming room, where the live streaming images can be pictures, animations, videos, etc., such as pictures captured in real time from the live streaming room. In this regard, the cover materials generated from the candidate materials can be in the form of text, pictures, animations, videos, etc.

[0088] As Figure 5 shown, a cover making control 501 is displayed in the live streaming room, and the trigger operation for the cover making control 501 is determined as the cover making trigger operation. Therefore, in response to the trigger operation for making a cover of the live streaming room, at least one source of cover materials is displayed, and in response to the selection operation for the source of cover materials, the selected source of cover materials is used as the source of materials for the at least one candidate material, thereby enriching the source of cover materials and improving the attractiveness of the cover materials.

[0089] In some embodiments, before step 1022, based on the selected candidate materials, cover generation processing is performed through a cover generation model to obtain cover materials, where the cover generation model is trained through candidate material samples and cover material annotations.

[0090] Among them, the embodiments of the present application are not limited to the model structure of the cover generation model. For example, the cover generation model can be a convolutional neural network, a deep neural network, etc.

[0091] It should be noted that before applying the cover generation model, an initial cover generation model needs to be trained and then the trained cover generation model is put into application. Among them, the cover generation model is trained through candidate material samples and cover material annotations. For example, based on the candidate material samples, the initial cover generation model is called to perform cover generation processing to obtain the generated cover material samples. After determining the value of the loss function of the cover generation model through the cover material samples and cover material annotations, it can be judged whether the value of the loss function exceeds the preset threshold. When the value of the loss function exceeds the preset threshold, the error signal of the cover generation model is determined based on the loss function, and the error information is backpropagated in the cover generation model, and the model parameters of each layer are updated during the propagation process. Among them, the embodiments of the present application are not limited to the form of the loss function. For example, it can be a cross-entropy loss function, an L2 loss function, etc.

[0092] Here, the backpropagation is described. The training sample data is input into the input layer of the neural network model, passes through the hidden layer, and finally reaches the output layer and outputs the result. This is the forward propagation process of the neural network model. Since there is an error between the output result of the neural network model and the actual result, the error between the output result and the actual value is calculated, and the error is backpropagated from the output layer to the hidden layer until it reaches the input layer. During the backpropagation process, the values of the model parameters are adjusted according to the error, that is, a loss function is constructed according to the error between the output result and the actual value, and the partial derivatives of the loss function with respect to the model parameters are calculated layer by layer to generate the gradients of the loss function with respect to the model parameters of each layer. Since the direction of the gradient indicates the direction of error expansion, the gradient of the model parameters is taken as the opposite, and the sum is taken with the original parameters of each layer of the model. The obtained sum result is used as the updated model parameters of each layer, so as to reduce the error caused by the model parameters; the above process is continuously iterated until convergence. Among them, the cover generation model is a kind of neural network model.

[0093] In some embodiments, the cover generation process is performed through the cover generation model to obtain cover materials, including: the cover generation model performs the following processing: obtaining the cover material style; based on the cover material style, performing cover generation processing on the selected candidate materials to obtain cover materials with the cover material style.

[0094] Here, the cover material style is obtained first, and then based on the cover material style, the selected candidate materials are subjected to cover generation processing to obtain cover materials with the cover material style, so that the cover material style can be incorporated into the cover materials to automatically generate cover materials with the cover material style.

[0095] In some embodiments, the cover material style can be obtained by manual input. For example, a style editing area is displayed, and the input cover material style is received through the style editing area.

[0096] In some embodiments, the cover material style can be obtained by an automatic acquisition method. For example, in response to a selection operation on a candidate material, a cover material style is generated, that is, after the candidate material is selected, a cover material is automatically generated.

[0097] In some embodiments, the cover material style can be generated in the following manner: Obtain a target live cover, where the target live cover includes at least one of the following: a historical live cover in the historical live covers of the live broadcast room with a popularity greater than a popularity threshold, a live cover formed by a viewer account corresponding to the viewer client editing a historical live broadcast room, and a similarity between the historical live broadcast room and the live broadcast room greater than a similarity threshold; perform a style prediction process on the target live cover to obtain the cover material style.

[0098] Among them, the popularity is positively correlated with the following parameters: the positive emotion type expressed by the positive feedback on the historical live cover, and the number of times of positive feedback on the historical live cover. For example, positive feedback is feedback that can reflect positive emotions such as likes and rewards for the historical live cover. When the positive emotion expressed by the positive feedback on the historical live cover is stronger, the popularity is higher; when the number of times of positive feedback on the virtual venue is more, the popularity is higher.

[0099] In some embodiments, when the type of the selected candidate material is one, based on the cover material style, perform a cover generation process on the selected candidate material to obtain a cover material with the cover material style, which can be achieved in the following manner: Perform a feature extraction process on the candidate material of one type to obtain cover features; perform an encoding process on the cover material style and the cover features to obtain a cover encoding feature; perform an image synthesis process on the cover encoding feature to obtain a cover material with the cover material style.

[0100] For example, when the candidate material is a picture material, perform a feature extraction process on the picture material to obtain cover features, perform an encoding process on the cover material style and the cover features to obtain a cover encoding feature, and perform an image synthesis process on the cover encoding feature to obtain a cover material with the cover material style to implement the function of generating an image from an image; when the candidate material is a text material, perform a feature extraction process on the text material to obtain cover features, perform an encoding process on the cover material style and the cover features to obtain a cover encoding feature, and perform an image synthesis process on the cover encoding feature to obtain a cover material with the cover material style to implement the function of generating an image from text.

[0101] In some embodiments, when there are multiple types of selected candidate materials, based on the cover material style, the selected candidate materials are processed for cover generation to obtain a cover material with the cover material style, which can be achieved in the following ways: Feature extraction processing is respectively performed on multiple types of candidate materials to obtain multiple types of cover features; Fusion processing is performed on multiple types of cover features to obtain a fusion feature; Encoding processing is performed on the cover material style and the fusion feature to obtain a cover encoding feature; Image synthesis processing is performed on the cover encoding feature to obtain a cover material with the cover material style.

[0102] For example, when the candidate materials are picture materials and text materials, feature extraction processing is performed on the picture materials to obtain cover features of the picture type, feature extraction processing is performed on the text materials to obtain cover features of the text type, fusion processing is performed on the cover features of the picture type and the cover features of the text type to obtain a fusion feature, encoding processing is performed on the cover material style and the fusion feature to obtain a cover encoding feature, and image synthesis processing is performed on the cover encoding feature to obtain a cover material with the cover material style, so as to implement the function of generating pictures from text and pictures.

[0103] In some embodiments, after step 102, in response to a reward setting operation for the cover material, the set cover reward is displayed, where the cover reward is used to indicate the reward that can be obtained after entering the live broadcast room through the cover material, and the produced cover material carries the cover reward.

[0104] As an example, when making a live broadcast cover, the audience submitting the cover can set the cover reward for the cover material, and attract more popularity for the anchor by setting the cover reward. After the reward setting is completed, the produced cover material carries the cover reward. For example, the cover reward can be displayed on the cover material. After sending the cover material to the anchor client, the cover material can be displayed on the anchor client side for the anchor to review. Among them, the cover material displayed on the anchor client shows the cover reward. After the anchor reviews and approves it, the current live broadcast cover of the live broadcast room is updated to the cover material showing the cover reward; The cover reward can also be submitted to the anchor client together with the cover material in the form of a prompt message for the anchor client to review. On the anchor client side, the cover material and the prompt message of the cover reward can be displayed. After the anchor reviews and approves it, the current live broadcast cover of the live broadcast room is updated to the cover material, and the prompt message of the cover reward is displayed. Among them, the embodiments of the present application are not limited to the form of the cover reward. For example, the cover reward can be virtual gold coins that can be obtained after entering the live broadcast room through the cover material, rare virtual equipment in the game, etc.

[0105] In step 103, in response to the sending operation for the cover material, an update request carrying the cover material is sent to the host client, where the update request is used to request the host client to confirm updating the current live cover of the live broadcast room to the cover material.

[0106] In some embodiments, in response to the sending operation for the cover material, sending an update request carrying the cover material to the host client includes: displaying at least one sending control for the cover material, where different sending controls correspond to different sending methods, and the sending methods include a streaming method and a private message method; in response to the triggering operation for the target sending control, sending an update request carrying the cover material to the host client based on the sending method corresponding to the target sending control, where the target sending control is any sending control.

[0107] For example, when the sending method corresponding to the target sending control is the streaming method, then an update request carrying the cover material is sent to the host client based on the streaming method. As Figure 9 shown, a message reminder box 901 is displayed on the streaming interface of the host client to remind the current host to confirm updating the current live cover of the live broadcast room to the cover material. When the sending method corresponding to the target sending control is the private message method, then an update request carrying the cover material is sent to the host client based on the private message method to privately message the current host to confirm updating the current live cover of the live broadcast room to the cover material.

[0108] In some embodiments, after sending an update request carrying the cover material to the host client in response to the sending operation for the cover material, in response to receiving a rejection message from the host client for the update request, a first prompt message is displayed, where the first prompt message is used to indicate that the host client rejects updating the current live cover of the live broadcast room to the cover material and the viewer client cannot send an update request to the host client again within a set time; in response to an inquiry operation triggered based on the first prompt message, an inquiry request is sent to the host client, where the inquiry request is used to inquire about the cover production requirements for the live broadcast room. Here, the set time can start from the moment when the host client rejects updating the current live cover of the live broadcast room to the cover material, or can start from the moment when the viewer client sends an update request carrying the cover material to the host client. The embodiments of the present application are not limited to the start time point of the set time.

[0109] Here, when the host rejects updating the current live cover of the live broadcast room to the cover material, the viewer client cannot send an update request to the host client again within the set time. For example, starting from the moment when the host client rejects updating the current live cover of the live broadcast room to the cover material, no update request can be sent to the host within 5 minutes to avoid viewers affecting the host's live broadcast. As Figure 12BThe first prompt message shown. In the first prompt message, the private chat with the host control 1202 can be displayed, and the trigger operation for the private chat with the host control 1202 is determined as an inquiry operation triggered based on the first prompt message. By privately chatting with the host to inquire about the host's requirements for the cover production of the live room, so that subsequent viewers can produce a live cover that meets the host's needs based on the host's requirements for the cover production of the live room.

[0110] In step 104, in response to receiving the confirmation message from the host client for the update request, update the current live cover of the live room to the cover material.

[0111] In some embodiments, when updating the current live cover of the live room to the cover material in response to receiving the confirmation message from the host client for the update request, a first notification message can also be displayed. The first notification message is used to notify that the current live cover of the live room has been updated to the cover material. In response to the reward viewing operation triggered based on the first notification message, display the reward generated by updating the current live cover to the cover material. Among them, the embodiments of the present application are not limited to the form of the reward. For example, the reward can be virtual coins, rare virtual equipment in the game, etc.

[0112] As Figure 12A The first notification message shown. If the host agrees to use the cover material sent by the viewer, the first notification message is displayed on the viewer client (i.e., the viewer side). The view reward control 1201 is displayed in the first notification message, and the trigger operation for the view reward control 1201 is determined as the reward viewing operation triggered based on the first notification message, and display the reward generated by updating the current live cover to the cover material. Among them, the reward can be issued by the host or by the live broadcast system.

[0113] In some embodiments, when updating the current live cover of the live room to the cover material in response to receiving the confirmation message from the host client for the update request, the label of the current live cover of the live room can also be updated to the label of the cover material.

[0114] Here, when the current live cover of the live room is updated to the cover material, the label of the current live cover of the live room can be synchronously updated to the label of the cover material to reflect the real live situation of the live room in real time.

[0115] In some embodiments, when displaying the produced cover material in response to the cover production operation for the live room, in response to the label setting operation for the cover material, the set label can be used as the label of the cover material.

[0116] As Figure 11As shown, when making the cover material, the audience can update the tags of the live room for the host in real time, that is, select appropriate tags from the displayed multiple candidate tags as the tags of the live room (i.e., the tags of the cover material) to complete the tag setting operation for the cover material. For example, select a singing tag from the game tag, singing tag, hot dance tag, and nature tag, and click the submission control 1101. In this way, the singing tag is selected for the live room, indicating that the host of this live room is singing. In this way, users can immediately understand the live content of the host based on the live cover and also know what category the host is currently live streaming, improving the accuracy of the preview information and greatly increasing the user click retention time.

[0117] In some embodiments, in response to the cover production operation for the live room, when displaying the produced cover material, tag prediction processing can also be performed based on the current live video of the live room and the cover material by invoking a tag prediction model to obtain the tags of the cover material. Among them, the tag prediction model is trained through live video samples, cover material samples, and tag annotations.

[0118] Among them, the embodiments of the present application are not limited to the model structure of the tag prediction model. For example, the tag prediction model can be a convolutional neural network, a deep neural network, etc.

[0119] It should be noted that before applying the tag prediction model, an initial tag prediction model needs to be trained, and then the trained tag prediction model is put into application. Among them, the tag prediction model is trained through live video samples, cover material samples, and tag annotations. For example, based on the live video samples and cover material samples, the initial tag prediction model is invoked to perform tag prediction processing to obtain the predicted tags. After determining the value of the loss function of the tag prediction model through the predicted tags and the predicted tags, it can be determined whether the value of the loss function exceeds a preset threshold. When the value of the loss function exceeds the preset threshold, the error signal of the tag prediction model is determined based on the loss function, and the error information is backpropagated in the tag prediction model, and the model parameters of each layer are updated during the propagation process. Among them, the embodiments of the present application are not limited to the form of the loss function. For example, it can be a cross-entropy loss function, an L2 loss function, etc.

[0120] As mentioned above, the live cover processing method provided by the embodiments of the present application can be implemented by various types of electronic devices, such as terminals, servers, or a combination of both. Therefore, the execution subjects of each step will not be repeated below. Refer to Figure 4 , Figure 4 is a schematic flowchart of the live cover processing method provided by the embodiments of the present application, Figure 4 The shown live cover processing method is applied to the host client and will be described in combination with Figure 4 the steps shown.

[0121] In step 201, the live broadcast room is displayed.

[0122] In step 202, in response to receiving an update request carrying cover material sent by the viewer client, a prompt message for the update request is displayed, where the update request is used to request the host client to confirm updating the current live cover of the live broadcast room to the cover material.

[0123] Here, embodiments of the present application can display the prompt message in a push stream manner. As Figure 9 shown, a message reminder box 901 (i.e., the prompt message) is displayed on the push stream interface of the host client to remind the current host to confirm updating the current live cover of the live broadcast room to the cover material. Embodiments of the present application can also display the prompt message in a private message manner, for example, display the prompt message in the private message interface.

[0124] In some embodiments, before step 202, a cover upload switch can be displayed, where the on state of the cover upload switch indicates that the viewer client is allowed to send an update request to the host client, and the off state of the cover upload switch indicates that the viewer client is prohibited from sending an update request to the host client; in response to an opening trigger operation for the cover upload switch, the current state of the cover upload switch is set to the on state.

[0125] Here, only when the host turns on the cover upload switch can the viewer upload the latest live cover, that is, the viewer client sends an update request to the host client. As Figure 8 shown, for the host, during the live broadcast, if the cover update switch 801 (i.e., the cover upload switch) of the host client is in the on state, as long as a viewer uploads the latest live cover, a message reminder box (toast) will be displayed on the host's push stream interface.

[0126] In some embodiments, after step 202, in response to a preview trigger operation based on the prompt message, a preview image of the cover material is displayed.

[0127] As Figure 9 shown, a message reminder box 901 (i.e., the prompt message) is displayed on the push stream interface of the host client to remind the current host that the user has uploaded the latest live cover. A preview control 903 is displayed in the message reminder box 901, and the trigger operation for the preview control 903 is determined as the preview trigger operation based on the prompt message, and a preview image 904 of the cover material is displayed to preview the large image.

[0128] In step 203, in response to a confirmation operation for the prompt message, the current live cover of the live broadcast room is updated to the cover material.

[0129] In some embodiments, when updating the current live cover of the live broadcast room to the cover material in response to a confirmation operation for the prompt message, a second notification message may also be displayed, where the second notification message is used to notify that the current live cover of the live broadcast room has been updated to the cover material sent by the viewer client.

[0130] Next, an exemplary application of the embodiments of the present application in an actual application scenario will be described.

[0131] The applicant found that the live covers in the related art rely on the host's own production. Since many hosts have no experience in making the live broadcast room cover, the live cover is not beautiful and the user click-through rate is low; there is a lack of a feedback mechanism for the live cover, and the content of many live broadcast rooms is very different from the content expressed by the live cover; the audience cannot give full play to their creative level and cannot participate in the cover production, and the interaction rate between users and hosts is low.

[0132] To solve the above problems, the embodiments of the present application provide a live cover processing method. Users can make high-quality covers for the host to bring more traffic to the host. The host can reward the users. The viewers watching the live broadcast can give feedback such as liking and commenting on the high-quality cover according to the live content. Finally, the live broadcast platform gives creative rewards to the users of these high-quality covers with good feedback, and also increases the exposure of this host, thus bringing benefits to both users and hosts at the same time, and also greatly stimulating the creative level of users, so that the live cover can better bring the most real portrayal of the host. Therefore, users can make various real and cool live covers for the host to attract more users to click and better drain traffic; a new mechanism for users to feedback on the live cover according to the viewing content is added, so that the live cover can better reflect the live content; users give full play to their creative level, bring benefits to themselves, and also bring cover click traffic to the host, increasing the interaction rate between users and hosts.

[0133] Next, the product solutions related to the live cover processing method provided by the embodiments of the present application will be described.

[0134] As Figure 6As shown, users can select tags and sort by click-through rate for various live stream covers displayed on the live stream home page. Among them, the live stream cover corresponds to the entrance of the live stream room. For example, when the user clicks on the tag selection control 601 on the live stream home page, the live stream covers displayed on the live stream home page are filtered. For example, if the selected tag is "singing", only the live stream covers with the tag "singing" are displayed on the live stream home page, and the live stream covers with other tags are hidden; when the user clicks on the click-through rate sorting control 602 on the live stream home page, the live stream covers displayed on the live stream home page are sorted according to the click-through rate of the live stream cover. The click-through rate here is calculated. For example, when the corresponding live stream room is exposed, the exposure count of the live stream cover is incremented by 1; when the corresponding live stream room is clicked, the click count of the live stream cover is incremented by 1. Finally, the click-through rate of the live stream cover is = click count / exposure count. When the exposure counts of the live stream covers are the same, the higher the click-through rate, the more attractive the live stream cover is to the user, and then the user clicks in to watch. When the user enters the live stream room to watch, the viewing duration is reported, and then the viewing durations of multiple users are averaged to obtain a retention duration. The longer the retention duration, the more wonderful the live stream content of the current anchor is and the more users can be retained.

[0135] As Figure 6 shown, users browse the corresponding live stream covers and click to watch. Among them, the displayed live stream covers carry category tags (abbreviated as tags) of the live stream content of the current anchor. For example, the anchor is dancing hotly, the anchor is singing, the anchor is exploring the deep sea, and the anchor is attacking in the game.

[0136] It should be noted that the live stream cover can be created by the user in real time according to the live stream content of the anchor, and the user can select and produce the live stream cover for the anchor in real time.

[0137] As Figure 7 shown, when the user watches the live stream, the user can take a real-time screenshot and upload the anchor cover through the screenshot upload control 701 at the bottom, or can send a private message to the anchor through the private message anchor control 702. When the private message interface is opened, the produced live stream cover is automatically sent to the anchor, and then wait for the anchor's response.

[0138] As Figure 8 shown, for the anchor, during the live stream, if the cover update switch 801 on the anchor side for receiving user covers is in the on state, as long as a user uploads the latest live stream cover, a message reminder box (toast) will be displayed on the anchor's push stream interface. As Figure 9As shown, a message reminder box 901 is displayed on the live streamer's streaming interface to remind the current live streamer that the user has uploaded the latest live stream cover. The live streamer can click on the ignore control 902 to ignore this update reminder of the live stream cover, or click on the preview control 903 to preview the large image 904. If the live streamer is satisfied with this live stream cover, by clicking on the agree control 905, the newly uploaded live stream cover will take effect immediately, and the notification interface 1001 as shown in Figure 10 will be displayed to notify the live streamer that the live stream cover has been successfully replaced with the live stream cover uploaded by the user. The live streamer can reward the user by clicking on the thank-you user control to encourage the user to continue creating live stream covers; if the reject control 906 is clicked, the user cannot send a request to update the live stream cover to the live streamer within the set time (such as 5 minutes) to avoid affecting the live stream of the live streamer.

[0139] As Figure 11 shown by the label, the user can update the labels of the live streamer's live stream room in real time when making the live stream cover, that is, select a suitable label from multiple candidate labels as the label of the live stream room. For example, select a singing label from the game label, singing label, hot dance label, and nature label, and click on the submit control 1101. In this way, the singing label is selected for the live stream room, indicating that the live streamer of this live stream room is singing. In this way, users can understand the content of the live streamer's live stream based on the live stream cover in the first time, and also know what category the live streamer is currently live streaming, improving the accuracy of the preview information, and greatly increasing the user click retention time.

[0140] If the live streamer agrees to the update request of the live stream cover submitted by the user, the user side will receive a message reminder as shown in Figure 12A The user can click on the view reward control 1201 to view the rewards issued by the live stream platform and encourage the user to continue creating; if the live streamer rejects the update request of the live stream cover submitted by the user, the user side will receive a message reminder as shown in Figure 12B The user can click on the private chat with the live streamer control 1202 to actively private chat with the live streamer to understand the requirements of the live streamer for the cover production and accumulate experience for the next creation.

[0141] As Figure 13 shown by the live streamer's private message interface 1301, when user A makes a live stream cover, the live stream system will automatically send the made live stream cover to the live streamer side to remind the live streamer to agree. If the live streamer rejects the live stream cover, the user side will also receive a private message from the live streamer. Then user A will ask the live streamer the reason for the rejection, and then the live streamer will privately chat with the user about the requirements for the live stream cover. The user replies "Okay", and the live stream system notification will issue a continue creation message. The user can click to quickly jump to the live streamer's live stream room and continue to take screenshots to make the cover.

[0142] As can be seen from the above product solution, the embodiments of the present application can facilitate users to quickly create screenshots to help the anchor create a live cover for wonderful moments. Users and the anchor can communicate via private messages, which improves the stickiness between users and the anchor. The content submitted by users can be quickly received by the anchor, reducing the waiting time and preventing users from losing patience. It also lays the foundation for real-time live covers.

[0143] The following Figure 14 describes the technical solutions involved in the live cover processing method provided by the embodiments of the present application.

[0144] Step 1: Upload the live cover by taking a screenshot on the terminal.

[0145] Here, after the anchor starts the live broadcast, users enter the live broadcast room to watch. When the anchor has a wonderful moment or the user sends a luxurious gift, the user can take a screenshot at this wonderful moment to obtain the live cover and upload the live cover.

[0146] Step 2: Notify the anchor through the background to confirm the update of the live cover.

[0147] Here, the notification form includes two aspects: the private message method and the push stream method (i.e., toast prompt).

[0148] Step 3: Display the preview image.

[0149] Here, after the user uploads the latest live cover, the anchor can click on the preview control in the toast prompt to preview the large image (i.e., the preview image of the live cover uploaded by the user).

[0150] Step 4: Update the live cover in the live broadcast room.

[0151] Here, if the anchor is satisfied with this live cover, the anchor agrees to update the current live cover and tags in the live broadcast room based on the live cover uploaded by the user. The anchor can reward the user by issuing a reward to thank the user and encourage the user to continue creating live covers.

[0152] Step 5: Send a private message to the user.

[0153] Here, if the anchor is not satisfied with this live cover, the anchor refuses to update the current live cover in the live broadcast room based on the live cover uploaded by the user. At this time, a notice will be actively sent to the corresponding user. The anchor sends a private message to the user so that the user can contact the anchor. After receiving the notice in the private message, the user can ask the anchor for the reason for the refusal to gain experience for the next creation.

[0154] Such as Figure 15As shown in the figure, for the live broadcast cover, the exposure and click of the live broadcast cover are reported, and then when the user watches, the viewing duration of the user is reported. These are strongly related indicators for the data analysis and display of the live broadcast homepage. Users can filter and display content according to these indicators, and can filter out more content they like. The embodiments of the present application involve data reporting and real-time screenshot uploading, can connect the private message module, are simple to use, have strong versatility and are easy to expand, provide real-time host covers to users, so that users can quickly understand the host's style without entering the live broadcast room, and more commercial functions can be combined in the later stage to improve the stickiness between users and hosts and improve the user's creation income level.

[0155] In summary, the live broadcast cover processing method provided by the embodiments of the present application has the following beneficial effects: 1. The real-time live broadcast cover allows other users to quickly understand the current host's live broadcast content and style. By allowing users to tag, users who are enthusiastic about the same category can quickly gather together; 2. The real live broadcast cover can improve user retention rate and enhance user experience; 3. Users can give full play to their own creative level, bring benefits to themselves, and also bring cover click traffic to the host, increasing the interaction rate between users and hosts.

[0156] So far, the live broadcast cover processing method provided by the embodiments of the present application has been described in combination with the exemplary applications and implementations of the electronic devices provided by the embodiments of the present application. Next, the cooperation of each module in the live broadcast cover processing device 555 provided by the embodiments of the present application to implement the live broadcast cover processing solution will be described.

[0157] The first display module 5551 is used to display the live broadcast room; the production module 5552 is used to display the produced cover material in response to a cover production operation for the live broadcast room; the sending module 5553 is used to send an update request carrying the cover material to the host client in response to a sending operation for the cover material, where the update request is used to request the host client to confirm to update the current live broadcast cover of the live broadcast room to the cover material; the update module 5554 is used to update the current live broadcast cover of the live broadcast room to the cover material in response to receiving a confirmation message from the host client for the update request.

[0158] In some embodiments, the production module 5552 is further used to display at least one candidate material, where the type of the at least one candidate material includes at least one of the following: text material, picture material, voice material, video material; and display the produced cover material in response to a cover production operation based on the candidate material, where the cover material is edited and formed based on the at least one candidate material.

[0159] In some embodiments, the production module 5552 is further configured to display at least one candidate material, where the type of the at least one candidate material includes at least one of the following: text material, picture material, voice material, video material; in response to a selection operation on the candidate material, display the cover material automatically generated by the selected candidate material.

[0160] In some embodiments, before displaying the at least one candidate material, the production module 5552 is further configured to, in response to a trigger operation for cover production of the live broadcast room, display at least one cover material source, where the at least one cover material source includes: local materials of the viewer client, real-time live broadcast images of the live broadcast room, historical live broadcast images of the live broadcast room; in response to a selection operation on the cover material source, use the selected cover material source as the material source of the at least one candidate material.

[0161] In some embodiments, before displaying the cover material automatically generated by the selected candidate material, the production module 5552 is further configured to perform cover generation processing on the selected candidate material through a cover generation model to obtain the cover material, where the cover generation model is trained through candidate material samples and cover material annotations.

[0162] In some embodiments, the production module 5552 is further configured to perform the following processing through the cover generation model: obtain a cover material style; based on the cover material style, perform cover generation processing on the selected candidate material to obtain the cover material with the cover material style.

[0163] In some embodiments, the production module 5552 is further configured to display a style editing area and receive the input cover material style through the style editing area; or, in response to a selection operation on the candidate material, generate the cover material style.

[0164] In some embodiments, the production module 5552 is further configured to obtain a target live broadcast cover, where the target live broadcast cover includes at least one of the following: a historical live broadcast cover in the historical live broadcast covers of the live broadcast room with a popularity greater than a popularity threshold, a live broadcast cover edited by the viewer account corresponding to the viewer client for a historical live broadcast room, a similarity between the historical live broadcast room and the live broadcast room greater than a similarity threshold; perform style prediction processing on the target live broadcast cover to obtain the cover material style.

[0165] In some embodiments, the popularity is positively correlated with the following parameters: the type of positive emotion expressed by the positive feedback for the historical live broadcast cover, the number of times of positive feedback for the historical live broadcast cover.

[0166] In some embodiments, when the type of the selected candidate material is one, the production module 5552 is further configured to perform feature extraction processing on the candidate material of one type to obtain cover features; perform encoding processing on the cover material style and the cover features to obtain cover encoding features; perform image synthesis processing on the cover encoding features to obtain the cover material with the cover material style.

[0167] In some embodiments, when the types of the selected candidate materials are multiple, the production module 5552 is further configured to perform feature extraction processing on the candidate materials of multiple types respectively to obtain the cover features of the multiple types; perform fusion processing on the cover features of the multiple types to obtain fusion features; perform encoding processing on the cover material style and the fusion features to obtain cover encoding features; perform image synthesis processing on the cover encoding features to obtain the cover material with the cover material style.

[0168] In some embodiments, before displaying the live broadcast room, the first display module 5551 is further configured to display a list of live broadcast rooms, where the list of live broadcast rooms includes multiple candidate live broadcast room covers; perform at least one of the following processes on the list of live broadcast rooms: in response to a trigger operation on a sorting control, sort the multiple candidate live broadcast room covers; in response to a trigger operation on a tag selection control, display multiple candidate tags, and in response to a selection operation on the candidate tags, hide the candidate live broadcast room covers that do not match the selected candidate tags; in response to a trigger operation on the candidate live broadcast room cover, display the live broadcast room corresponding to the candidate live broadcast room cover.

[0169] In some embodiments, the sending module 5553 is further configured to display at least one sending control for the cover material, where different sending controls correspond to different sending methods, and the sending methods include a live streaming method and a private message method; in response to a trigger operation on a target sending control, send an update request carrying the cover material to the host client based on the sending method corresponding to the target sending control, where the target sending control is any of the sending controls.

[0170] In some embodiments, after sending an update request carrying the cover material to the host client in response to a sending operation for the cover material, the update module 5554 is further configured to display a first prompt message in response to receiving a rejection message from the host client for the update request, where the first prompt message is used to indicate that the host client rejects updating the current live cover of the live room to the cover material, and the viewer client cannot send the update request to the host client again within a set time; and in response to an inquiry operation triggered based on the first prompt message, send an inquiry request to the host client, where the inquiry request is used to inquire about the cover production requirements of the host client for the live room.

[0171] In some embodiments, when updating the current live cover of the live room to the cover material in response to receiving an acknowledgment message from the host client for the update request, the update module 5554 is further configured to display a first notification message, where the first notification message is used to notify that the current live cover of the live room has been updated to the cover material; and in response to a reward viewing operation triggered based on the first notification message, display the rewards generated by updating the current live cover to the cover material.

[0172] In some embodiments, when updating the current live cover of the live room to the cover material in response to receiving an acknowledgment message from the host client for the update request, the update module 5554 is further configured to update the label of the current live cover of the live room to the label of the cover material.

[0173] In some embodiments, when displaying the produced cover material in response to a cover production operation for the live room, the production module 5552 is further configured to, in response to a label setting operation for the cover material, use the set label as the label of the cover material.

[0174] In some embodiments, when displaying the produced cover material in response to a cover production operation for the live room, the production module 5552 is further configured to perform label prediction processing on the cover material by invoking a label prediction model based on the current live video of the live room and the cover material, to obtain the label of the cover material, where the label prediction model is trained through live video samples, cover material samples, and label annotations.

[0175] So far, the live cover processing method provided in the embodiments of the present application has been described in combination with the exemplary applications and implementations of the electronic device provided in the embodiments of the present application. Next, the cooperation of each module in the live cover processing device 655 provided in the embodiments of the present application to implement the live cover processing solution will be described.

[0176] A second display module 6551 for displaying a live broadcast room; a prompt module 6552 for, in response to receiving an update request carrying cover material sent by an audience client, displaying a prompt message of the update request, wherein the update request is used to request the host client to confirm updating the current live broadcast cover of the live broadcast room to the cover material; a determination module 6553 for, in response to a confirmation operation on the prompt message, updating the current live broadcast cover of the live broadcast room to the cover material.

[0177] In some embodiments, before displaying the prompt message of the update request in response to receiving an update request carrying cover material sent by an audience client, the prompt module 6552 is further configured to display a cover upload switch, wherein an on state of the cover upload switch represents that the audience client is allowed to send an update request to the host client, and an off state of the cover upload switch represents that the audience client is prohibited from sending an update request to the host client; in response to an on trigger operation on the cover upload switch, setting the current state of the cover upload switch to the on state.

[0178] In some embodiments, after displaying the prompt message of the update request in response to receiving an update request carrying cover material sent by an audience client, the prompt module 6552 is further configured to, in response to a preview trigger operation based on the prompt message, display a preview image of the cover material; when updating the current live broadcast cover of the live broadcast room to the cover material in response to a confirmation operation on the prompt message, the determination module 6553 is further configured to display a second notification message, wherein the second notification message is used to notify that the current live broadcast cover of the live broadcast room has been updated to the cover material sent by the audience client.

[0179] An embodiment of the present application provides a computer program product, which includes a computer program or computer executable instructions, and the computer program or computer executable instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer program or computer executable instructions from the computer-readable storage medium, and the processor executes the computer program or computer executable instructions, so that the electronic device executes the live broadcast cover processing method in the above embodiments of the present application.

[0180] An embodiment of the present application provides a computer-readable storage medium storing computer executable instructions, wherein computer executable instructions or a computer program are stored therein, and when the computer executable instructions or the computer program are executed by a processor, the processor will be caused to execute the live broadcast cover processing method provided by the embodiment of the present application, for example, Figure 3A the live broadcast cover processing method shown.

[0181] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; or may be various devices including one or any combination of the above memories.

[0182] In some embodiments, the computer-executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as a stand-alone program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0183] As an example, the computer-executable instructions may or may not correspond to a file in a file system, may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, stored in a single file dedicated to the program in question, or, stored in multiple cooperating files (such as files that store one or more modules, subroutines, or portions of code).

[0184] As an example, the computer-executable instructions may be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or, on multiple electronic devices distributed at multiple locations and interconnected by a communication network.

[0185] It can be understood that in the embodiments of the present application, when it comes to data related to user information, etc., when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0186] As described above, the above are only the embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are all included in the protection scope of the present application.

Claims

1. A live broadcast cover processing method, characterized in that, Applied to the viewer client, the method includes: Display the live streaming room. In response to an operation for creating a cover for the live streaming room, display the created cover material. In response to an operation for sending the cover material, send an update request carrying the cover material to the host client, where the update request is used to request the host client to confirm updating the current live cover of the live streaming room to the cover material. In response to receiving a confirmation message from the host client for the update request, update the current live cover of the live streaming room to the cover material.

2. The method according to claim 1, wherein The step of "In response to an operation for creating a cover for the live streaming room, display the created cover material" includes: Display at least one candidate material, where the type of the at least one candidate material includes at least one of the following: text material, picture material, voice material, video material. In response to an operation for creating a cover based on the candidate material, display the created cover material, where the cover material is edited and formed based on the at least one candidate material.

3. The method according to claim 1, wherein The step of "In response to an operation for creating a cover for the live streaming room, display the created cover material" includes: Display at least one candidate material, where the type of the at least one candidate material includes at least one of the following: text material, picture material, voice material, video material. In response to an operation for selecting the candidate material, display the cover material automatically generated by the selected candidate material.

4. The method according to claim 2 or 3, characterized in that Before the step of "display at least one candidate material", the method further includes: In response to a trigger operation for creating a cover for the live streaming room, display at least one cover material source, where the at least one cover material source includes: local materials of the viewer client, real-time live streaming images of the live streaming room, historical live streaming images of the live streaming room. In response to an operation for selecting the cover material source, use the selected cover material source as the material source of the at least one candidate material.

5. The method according to claim 3, wherein Before the step of "display the cover material automatically generated by the selected candidate material", the method further includes: Based on the selected candidate material, perform cover generation processing through a cover generation model to obtain the cover material, where the cover generation model is trained through candidate material samples and cover material annotations.

6. The method according to claim 5, wherein The step of "perform cover generation processing through a cover generation model to obtain the cover material" includes: Execute the following processing through the cover generation model: Obtain the cover material style. Based on the cover material style, perform cover generation processing on the selected candidate material to obtain the cover material with the cover material style.

7. The method according to claim 6, characterized in that The step of "obtain the cover material style" includes: Display a style editing area and receive the input cover material style through the style editing area; or, In response to an operation for selecting the candidate material, generate the cover material style.

8. The method according to claim 7, wherein The step of "generate the cover material style" includes: Obtain a target live cover, where the target live cover includes at least one of the following: a historical live cover in the historical live covers of the live room with a popularity greater than a popularity threshold, a live cover formed by editing the historical live room by the viewer account corresponding to the viewer client, and the similarity between the historical live room and the live room is greater than a similarity threshold; Perform a style prediction process on the target live cover to obtain the style of the cover material.

9. The method according to claim 8, characterized in that, The popularity is positively correlated with the following parameters: the type of positive emotion expressed by the positive feedback for the historical live cover, and the number of times of positive feedback for the historical live cover.

10. The method according to claim 6, wherein When the type of the selected candidate material is one, based on the style of the cover material, perform a cover generation process on the selected candidate material to obtain the cover material with the style of the cover material, including: Perform a feature extraction process on the candidate material of one type to obtain cover features; Perform an encoding process on the style of the cover material and the cover features to obtain cover encoded features; Perform an image synthesis process on the cover encoded features to obtain the cover material with the style of the cover material.

11. The method according to claim 6, wherein When the types of the selected candidate materials are multiple, based on the style of the cover material, perform a cover generation process on the selected candidate materials to obtain the cover material with the style of the cover material, including: Perform feature extraction processes on the candidate materials of multiple types respectively to obtain cover features of the multiple types; Perform a fusion process on the cover features of the multiple types to obtain fusion features; Perform an encoding process on the style of the cover material and the fusion features to obtain cover encoded features; Perform an image synthesis process on the cover encoded features to obtain the cover material with the style of the cover material.

12. The method according to any one of claims 1-11, wherein Before displaying the live room, the method further includes: Display a list of live rooms, where the list of live rooms includes multiple candidate live room covers; Perform at least one of the following processes on the list of live rooms: In response to a trigger operation on a sorting control, sort the multiple candidate live room covers; In response to a trigger operation on a tag selection control, display multiple candidate tags, and In response to a selection operation on the candidate tags, hide the candidate live room covers that do not match the selected candidate tags; The display of the live room includes: In response to a trigger operation on the candidate live room cover, display the live room corresponding to the candidate live room cover.

13. The method according to any one of claims 1-11, characterized in that, The sending of an update request carrying the cover material to the host client in response to a sending operation on the cover material includes: Display at least one sending control for the cover material, where different sending controls correspond to different sending methods, and the sending methods include a streaming method and a private message method; In response to a trigger operation on a target sending control, send an update request carrying the cover material to the host client based on the sending method corresponding to the target sending control, where the target sending control is any of the sending controls.

14. The method according to any one of claims 1 to 11, characterized in that, After sending the update request carrying the cover material to the host client in response to a sending operation on the cover material, the method further includes: In response to receiving a rejection message from the host client for the update request, display a first prompt message, where the first prompt message is used to indicate that the host client rejects updating the current live cover of the live room to the cover material, and the viewer client cannot send the update request to the host client again within a set time; In response to an inquiry operation triggered based on the first prompt message, send an inquiry request to the host client, where the inquiry request is used to inquire about the cover production requirements of the host client for the live room.

15. The method according to any one of claims 1-11, characterized in that, When updating the current live cover of the live room to the cover material in response to receiving an acknowledgment message from the host client for the update request, the method further includes: Display a first notification message, where the first notification message is used to notify that the current live cover of the live room has been updated to the cover material; In response to a reward viewing operation triggered based on the first notification message, display the reward generated by updating the current live cover to the cover material.

16. The method according to any one of claims 1-11, characterized in that, When updating the current live cover of the live room to the cover material in response to receiving an acknowledgment message from the host client for the update request, the method further includes: Update the label of the current live cover of the live room to the label of the cover material.

17. The method according to claim 16, characterized in that, When displaying the produced cover material in response to a cover production operation on the live room, the method further includes: In response to a label setting operation on the cover material, use the set label as the label of the cover material.

18. The method according to claim 16, wherein When displaying the produced cover material in response to a cover production operation on the live room, the method further includes: Perform label prediction processing on the cover material by invoking a label prediction model based on the current live video of the live room and the cover material, to obtain the label of the cover material, where the label prediction model is trained by using live video samples, cover material samples, and label annotations.

19. A live broadcast cover processing method, characterized in that, Applied to the host client, the method includes: Display the live room; In response to receiving an update request carrying the cover material sent by the viewer client, display a prompt message for the update request, where the update request is used to request the host client to confirm updating the current live cover of the live room to the cover material; In response to an acknowledgment operation on the prompt message, update the current live cover of the live room to the cover material.

20. The method according to claim 19, wherein Before displaying the prompt message for the update request in response to receiving an update request carrying the cover material sent by the viewer client, the method further includes: A cover upload switch is displayed. Among them, the on state of the cover upload switch indicates that the viewer client is allowed to send an update request to the host client, and the off state of the cover upload switch indicates that the viewer client is prohibited from sending an update request to the host client; In response to an opening trigger operation for the cover upload switch, set the current state of the cover upload switch to the on state.

21. The method according to claim 19, wherein, After displaying a prompt message for the update request in response to receiving an update request carrying cover material sent by a viewer client, the method further includes: In response to a preview trigger operation based on the prompt message, display a preview image of the cover material; When updating the current live cover of the live room to the cover material in response to a confirmation operation for the prompt message, the method further includes: Display a second notification message, where the second notification message is used to notify that the current live cover of the live room has been updated to the cover material sent by the viewer client.

22. A live broadcast cover processing device, characterized in that, The apparatus includes: A first display module, configured to display a live room; A production module, configured to display the produced cover material in response to a cover production operation for the live room; A sending module, configured to send an update request carrying the cover material to the host client in response to a sending operation for the cover material, where the update request is used to request the host client to confirm updating the current live cover of the live room to the cover material; An update module, configured to update the current live cover of the live room to the cover material in response to receiving a confirmation message from the host client for the update request.

23. An electronic device, characterized in that, The electronic device includes: A memory, configured to store a computer program or computer-executable instructions; A processor, configured to implement the live cover processing method according to any one of claims 1 to 21 when executing the computer program or computer-executable instructions stored in the memory.

24. A computer-readable storage medium, characterized in that, A computer program or computer-executable instructions are stored, and when the computer program or computer-executable instructions are executed by a processor, the live cover processing method according to any one of claims 1 to 21 is implemented.

25. A computer program product, comprising a computer program or computer-executable instructions, characterized in that, When the computer program or computer-executable instructions are executed by a processor, the live cover processing method according to any one of claims 1 to 21 is implemented.

Images