Live broadcast processing method, device, electronic device and readable storage medium

Abstract

The present application provides a live broadcast processing method, device, electronic device and computer-readable storage medium; the method includes: displaying a shooting entrance in a live broadcast room; in response to a trigger operation on the shooting entrance, obtaining a current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, and displaying a thumbnail of the current live broadcast picture in the live broadcast room. Through the present application, it is possible to fully and effectively display the content of the live broadcast room.

Description

Technical Field

[0001] The present application relates to Internet technology, and in particular to a live broadcast processing method, device, electronic device and computer-readable storage medium. Background Art

[0002] With the rapid development of network technology (such as Internet technology), online live broadcast has become widely popular due to its advantages such as intuitiveness, rich content, strong interactivity, and no geographical restrictions. Through live broadcast technology, the anchor can broadcast live in the live broadcast room, and the audience can enter the live broadcast room where the anchor is located to watch the anchor's performance.

[0003] Currently, when watching the live broadcast of the anchor, the audience may miss key content or be unable to watch the key scenes that have been broadcast due to the limited live broadcast time. Since the interactive method is rigid and limited by time, the live broadcast effect is poor, and further the computing resources consumed during the live broadcast are wasted. Summary of the invention

[0004] The embodiments of the present application provide a live broadcast processing method, device, electronic device and computer-readable storage medium, which can fully and effectively display the content of the live broadcast room.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] The present application provides a live broadcast processing method, including:

[0007] Display the shooting entrance in the live broadcast room;

[0008] In response to a trigger operation on the shooting entry, a current live picture corresponding to a current time point of the trigger operation is obtained from the live stream of the live broadcast room, and

[0009] A thumbnail of the current live broadcast screen is displayed in the live broadcast room.

[0010] In the above technical solution, the step of acquiring the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room includes:

[0011] Acquire an optimal key picture whose decoding time point is close to the current time point of the trigger operation from the decoded live stream;

[0012] The optimal key picture is used as the current live picture corresponding to the current time point of the trigger operation.

[0013] In the above technical solution, obtaining the optimal key picture close to the current time point of the triggering operation from the decoded live stream includes:

[0014] A key picture whose decoding time point is closest to the current time point of the trigger operation is obtained from the decoded live stream, and the key picture is used as the optimal key picture close to the current time point of the trigger operation.

[0015] In the above technical solution, obtaining the optimal key picture close to the current time point of the triggering operation from the decoded live stream includes:

[0016] Acquire multiple candidate key images whose decoding time points are close to the current time point of the trigger operation from the decoded live stream, and acquire the interaction heat of the viewer account to the multiple candidate key images;

[0017] The candidate key picture corresponding to the highest interaction heat is used as the optimal key picture.

[0018] In the above technical solution, obtaining the optimal key picture close to the current time point of the triggering operation from the decoded live stream includes:

[0019] Acquire, from the decoded live stream, a plurality of candidate key pictures whose decoding time points are close to the current time point of the trigger operation;

[0020] Invoking a quality recognition model based on the multiple candidate key pictures to obtain quality scores of the multiple candidate key pictures;

[0021] The candidate key picture corresponding to the highest quality score is used as the optimal key picture.

[0022] In the above technical solution, the type of the current live broadcast screen includes one of the following: a picture, a video clip;

[0023] The thumbnail of the video clip and the thumbnail of the picture have different display styles, and the different display styles include at least one of the following: color, size, and special effects.

[0024] The present application provides a live broadcast processing device, including:

[0025] A first display module is used to display the shooting entrance in the live broadcast room;

[0026] An acquisition module, configured to, in response to a trigger operation on the shooting entry, acquire a current live broadcast picture corresponding to a current time point of the trigger operation from the live broadcast stream of the live broadcast room;

[0027] The second display module is used to display a thumbnail of the current live broadcast screen in the live broadcast room.

[0028] In the above technical solution, when at least one trigger operation for the shooting entrance has been received before the trigger operation, and a thumbnail of at least one corresponding historical live screen has been displayed in the live broadcast room, the second display module is further used to arrange and display thumbnails of multiple live screens in the live broadcast room, wherein the multiple live screens include the current live screen and at least one of the historical live screens;

[0029] In response to a trigger operation on any thumbnail, the live broadcast screen corresponding to the any thumbnail is displayed in the live broadcast room.

[0030] In the above technical solution, the second display module is further used to arrange and display some thumbnails of the thumbnails of the multiple live screens in the live broadcast room;

[0031] In response to a move operation on the portion of thumbnails, the portion of thumbnails displayed in the live broadcast room is updated according to a moving direction of the move operation.

[0032] In the above technical solution, the second display module is further used to arrange and display some thumbnails of the thumbnails of the multiple live screens in the live broadcast room, and display an expansion entrance in the live broadcast room;

[0033] In response to a trigger operation on the expansion entrance, thumbnails of the multiple live broadcast screens are arranged and displayed in the live broadcast room.

[0034] In the above technical solution, when the live broadcast picture corresponding to any one of the thumbnails is displayed in the live broadcast room, the second display module is further used to respond to the live broadcast picture switching operation and display a live broadcast picture among the multiple live broadcast pictures that is different from the live broadcast picture corresponding to any one of the thumbnails in the live broadcast room;

[0035] Wherein, each switching operation is used to trigger the display of a live screen adjacent to the live screen corresponding to any one of the thumbnails in the arrangement of the multiple live screens, or, each switching operation is used to trigger the display of a live screen at a corresponding position in the arrangement of the multiple live screens according to the amplitude of the switching operation.

[0036] In the above technical solution, when multiple thumbnails of live screens are arranged and displayed in the live broadcast room, the second display module is also used to respond to a selection operation on any one of the thumbnails and use the selected thumbnail as the current thumbnail;

[0037] In response to the position adjustment operation for the current thumbnail, the position of the current thumbnail is updated in the order in which the thumbnails of the multiple live screens are arranged.

[0038] In the above technical solution, the second display module is further used to arrange and display thumbnails of the multiple live broadcast pictures in the live broadcast room according to the shooting order of the multiple live broadcast pictures; or,

[0039] Thumbnails of the multiple live broadcast screens are arranged and displayed in the live broadcast room according to the interaction popularity order of the multiple live broadcast screens.

[0040] In the above technical solution, the second display module is further used to arrange and display the thumbnail of the current live screen before the thumbnail of the at least one historical live screen;

[0041] After the waiting period, thumbnails of the multiple live broadcast screens are displayed in the live broadcast room according to the shooting order or interaction popularity order of the multiple live broadcast screens.

[0042] In the above technical solution, the second display module is further used to update and display thumbnails of the multiple live broadcast screens in the live broadcast room according to the shooting order or interaction popularity order of the multiple live broadcast screens;

[0043] During the waiting period, the thumbnail of the current live screen is displayed in a different style from the thumbnail of the at least one historical live screen. When the waiting period is exceeded, the thumbnail of the current live screen is displayed in the same style as the thumbnail of the at least one historical live screen.

[0044] In the above technical solution, when a live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the device further includes:

[0045] An editing module, used for displaying an editing entry for the live broadcast screen in the live broadcast room;

[0046] In response to a trigger operation on the editing entry, displaying an editing interface for the live broadcast screen in the live broadcast room;

[0047] In response to an editing operation on the live broadcast screen in the editing interface, the edited live broadcast screen is displayed in the live broadcast room.

[0048] In the above technical solution, before the editing interface for the live broadcast screen is displayed in the live broadcast room, the editing module is further used to obtain an account for implementing a triggering operation for the editing entry;

[0049] When the account is an anchor account or an anchor secondary account with editing authority, it is determined that a trigger operation for the editing entry will be responded to.

[0050] In the above technical solution, when a live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the second display module is also used to display an interactive entrance for the live broadcast screen in the live broadcast room;

[0051] In response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, the interactive information on the live broadcast screen is displayed in the live broadcast room.

[0052] In the above technical solution, the second display module is also used to display an interactive entrance for the thumbnail in the live broadcast room;

[0053] In response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, the interactive information on the thumbnail is displayed in the live broadcast room.

[0054] In the above technical solution, before obtaining the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, the acquisition module is also used to obtain the account that implements the trigger operation;

[0055] When the account is an anchor account with shooting authority, it is determined that a trigger operation of the shooting entrance by the user account will be responded to.

[0056] In the above technical solution, the acquisition module is also used to acquire the account number for implementing the trigger operation;

[0057] When the account does not have the permission to shoot, the shooting authorization entrance is displayed;

[0058] The shooting authorization entry is used to apply for shooting permission;

[0059] When the account implementing the trigger operation applies for shooting permission and is approved by the anchor account, it is determined to obtain the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room.

[0060] In the above technical solution, the acquisition module is further used to acquire multiple candidate key pictures close to the current time point of the trigger operation from the decoded live stream, and display the multiple candidate key pictures;

[0061] In response to a selection operation on the plurality of candidate key pictures, the selected candidate key picture is used as the current live broadcast picture.

[0062] In the above technical solution, the acquisition module is further used to acquire, from the decoded live stream, the optimal key picture whose decoding time point is close to the current time point of the trigger operation;

[0063] The optimal key picture is used as the current live picture corresponding to the current time point of the trigger operation.

[0064] In the above technical solution, the acquisition module is also used to obtain the key picture whose decoding time point is closest to the current time point of the trigger operation in the decoded live stream, and use the key picture as the optimal key picture close to the current time point of the trigger operation.

[0065] In the above technical solution, the acquisition module is further used to acquire multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation from the decoded live stream, and acquire the interaction heat of the viewer account to the multiple candidate key pictures;

[0066] The candidate key picture corresponding to the highest interaction heat is used as the optimal key picture.

[0067] In the above technical solution, the acquisition module is further used to acquire, from the decoded live stream, a plurality of candidate key pictures whose decoding time points are close to the current time point of the trigger operation;

[0068] Invoking a quality recognition model based on the multiple candidate key pictures to obtain quality scores of the multiple candidate key pictures;

[0069] The candidate key picture corresponding to the highest quality score is used as the optimal key picture.

[0070] In the above technical solution, the type of the current live broadcast screen includes one of the following: a picture, a video clip;

[0071] The thumbnail of the video clip and the thumbnail of the picture have different display styles, and the different display styles include at least one of the following: color, size, and special effects.

[0072] An embodiment of the present application provides an electronic device for live broadcast processing, the electronic device comprising:

[0073] A memory for storing executable instructions;

[0074] The processor is used to implement the live broadcast processing method provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0075] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for causing a processor to execute and implement the live broadcast processing method provided in the embodiment of the present application.

[0076] The embodiments of the present application have the following beneficial effects:

[0077] A shooting entrance is displayed in the live broadcast room to show thumbnails of the live broadcast screen in the live broadcast room, so that the thumbnails of the live broadcast screen that the user is interested in can be displayed without leaving the live broadcast room, thereby supporting users to share the live broadcast content in the live broadcast room by shooting, improving the interactive efficiency and effect of the live broadcast, and saving related communication resources and computing resources compared to users' interactive solutions based on the live broadcast screen outside the live broadcast room. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 It is a schematic diagram of the architecture of the live broadcast system provided in an embodiment of the present application;

[0079] Figure 2 is a structural schematic diagram of an electronic device for live broadcast processing provided in an embodiment of the present application;

[0080] Figure 3 It is a flowchart of a live broadcast processing method provided in an embodiment of the present application;

[0081] Figure 4A This is a schematic diagram of the interaction on the host side provided in an embodiment of the present application;

[0082] Figure 4B is a schematic diagram of an interface for arranging thumbnails provided in an embodiment of the present application;

[0083] Figure 4C is an interactive schematic diagram of thumbnail movement provided in an embodiment of the present application;

[0084] Figure 4D is an interactive schematic diagram of thumbnail expansion provided in an embodiment of the present application;

[0085] Figure 4E is an interactive schematic diagram of thumbnail position adjustment provided in an embodiment of the present application;

[0086] Figure 4F It is an interactive schematic diagram of thumbnail editing provided by an embodiment of the present application;

[0087] Figure 4G is a schematic diagram of thumbnail interaction provided in an embodiment of the present application;

[0088] Figure 4H is a schematic diagram of live screen interaction provided by an embodiment of the present application;

[0089] Figure 5 It is a schematic diagram of an interface for displaying multiple thumbnails in a live broadcast room provided by an embodiment of the present application;

[0090] Figure 6It is a schematic diagram of interaction for viewing thumbnails on the audience side provided in an embodiment of the present application;

[0091] Figure 7 It is a schematic diagram of the interaction of switching screens on the audience side provided in an embodiment of the present application;

[0092] Fig. 8A It is a schematic diagram of interaction for the audience to apply for authorization provided in an embodiment of the present application;

[0093] Figure 8B This is a schematic diagram of an interface for a host side to receive an authorization request provided in an embodiment of the present application;

[0094] Fig. 9A It is a schematic diagram of the interaction process on the anchor side provided in an embodiment of the present application;

[0095] Fig. 9B It is a schematic diagram of an interface for displaying thumbnails on the anchor side provided in an embodiment of the present application;

[0096] Fig. 10A It is a schematic diagram of an interface for displaying multiple thumbnails on the host side provided in an embodiment of the present application;

[0097] Fig. 10B This is a schematic diagram of the interaction on the host side provided in an embodiment of the present application;

[0098] Fig. 10C It is a schematic diagram of an interface for displaying thumbnails on the viewer side provided in an embodiment of the present application;

[0099] Fig.11 It is a schematic diagram of an interface for displaying thumbnails on the viewer side provided in an embodiment of the present application;

[0100] Fig.12 is a schematic diagram of interaction on the audience side provided in an embodiment of the present application;

[0101] Fig.13 It is a schematic diagram of interaction for viewing thumbnails on the audience side provided in an embodiment of the present application;

[0102] Fig.14 It is an interactive schematic diagram of a magnified image on the audience side provided by an embodiment of the present application;

[0103] Fig.15 It is an interactive schematic diagram of switching screens on the audience side provided in an embodiment of the present application. DETAILED DESCRIPTION

[0104] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0105] In the following description, the terms "first\second" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0106] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0107] The relevant data collection and processing in the embodiments of this application should be strictly in accordance with the requirements of relevant laws and regulations when applied in examples, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of authorization of laws and regulations and the personal information subject.

[0108] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0109] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.

[0110] 2) Live broadcast: information is produced and released synchronously with the occurrence and development of events on site, and it is a two-way information network publishing method. For example, data from the broadcaster (i.e., the anchor account) can be collected through specific equipment, and after a series of processing (such as compression into a viewable and transmittable video stream based on video encoding technology), it is output to the viewing user end (i.e., the audience account), thereby realizing live broadcast.

[0111] 3) Live broadcast room: In the Internet era, it refers to a live broadcast program opened by a certain person or organization. Audience accounts can enter the live broadcast room to watch the live broadcast program.

[0112] 4) Anchor account: The account held by the anchor to enter the live broadcast room for performance.

[0113] 5) Anchor's secondary account (also called anchor's small account): In addition to the anchor's account, an account that can enter the live broadcast room as the anchor (specifically, the anchor's secondary account) and has most of the anchor's operating permissions.

[0114] 6) Audience account: An account held by the audience to enter the live broadcast room and watch the host's performance.

[0115] The embodiments of the present application provide a live broadcast processing method, device, electronic device and computer-readable storage medium, which can fully and effectively display the content of the live broadcast room.

[0116] The video processing method provided in the embodiment of the present application can be implemented by the terminal alone; it can also be implemented by the terminal and the server in collaboration. For example, the terminal alone undertakes the live broadcast processing method described below, or the terminal sends the current live broadcast picture to the server, and the server sends the current live broadcast picture to other terminals entering the live broadcast room based on the received current live broadcast picture, so as to display the thumbnail of the current live broadcast picture on the other terminals, so as to realize the synchronous display of the live broadcast room.

[0117] The following describes an exemplary application of the electronic device provided by the embodiment of the present application. The electronic device provided by the embodiment of the present application can be implemented as various types of user terminals such as a laptop computer, a tablet computer, a desktop computer, a set-top box, a mobile device (for example, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable gaming device, and a vehicle-mounted device). The following describes an exemplary application when the electronic device is implemented as a terminal.

[0118] See also Figure 1 , Figure 1 It is a schematic diagram of the architecture of the live broadcast system 10 provided in an embodiment of the present application, wherein the terminals (terminal 200-1 and terminal 200-2 are shown as examples) are connected to the server 100 via a network 300, wherein the network 300 may be a wide area network or a local area network, or a combination of the two.

[0119] In some embodiments, taking the electronic device as a terminal as an example, the live broadcast processing method provided in the embodiment of the present application can be implemented by the terminal. For example, the terminal 200-1 displays a shooting entrance in the live broadcast room, and in response to a trigger operation on the shooting entrance, obtains the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, and displays a thumbnail of the current live broadcast picture in the live broadcast room, thereby fully sharing the live broadcast picture during the live broadcast process and improving the interaction efficiency and live broadcast effect.

[0120] In some embodiments, the live broadcast processing method provided in the embodiments of the present application can also be implemented by the server and the terminal in collaboration. For example, the terminal 200-1 displays a shooting entrance in the live broadcast room, and in response to a trigger operation on the shooting entrance, obtains the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, and sends the current live broadcast picture to the server 100. The server 100 sends the current live broadcast picture to the terminal 200-2 that enters the live broadcast room according to the received current live broadcast picture, so as to display a thumbnail of the current live broadcast picture on the terminal 200-2, so as to realize the synchronous display of the thumbnail of the current live broadcast picture in the live broadcast room, thereby fully sharing the live broadcast picture during the live broadcast process and improving the interaction efficiency and live broadcast effect.

[0121] In some embodiments, the terminal or server can implement the live broadcast processing method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP, Application), that is, a program that needs to be installed in the operating system to run, such as a live broadcast application; it can also be a small program, that is, a program that can be run only by downloading it to a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be an application, module or plug-in in any form.

[0122] In some embodiments, server 100 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), as well as big data and artificial intelligence platforms. Among them, the cloud service can be a live broadcast processing service for terminals to call.

[0123] In some embodiments, multiple servers may form a blockchain, and server 100 is a node on the blockchain. Information connections may exist between each node in the blockchain, and information may be transmitted between nodes through the above information connections. Among them, data related to the live broadcast processing method provided in the embodiment of the present application (such as the logic of live broadcast processing and the current live broadcast screen) may be stored on the blockchain.

[0124] The structure of the electronic device for live broadcast processing provided by the embodiment of the present application is described below. Figure 2 , Figure 2 1 is a schematic diagram of the structure of an electronic device 500 for live broadcast processing provided in an embodiment of the present application. Take the electronic device 500 as an example, Figure 2The electronic device 500 for live broadcast processing shown includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Figure 2 Various buses are labeled as bus system 540 .

[0125] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0126] The memory 550 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiment of the present application is intended to include any suitable type of memory. The memory 550 optionally includes one or more storage devices that are physically far away from the processor 510.

[0127] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.

[0128] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0129] A network communication module 552, for reaching other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 include: Bluetooth, Wireless Compatibility Certification (WiFi), and Universal Serial Bus (USB);

[0130] In some embodiments, the live broadcast processing device provided in the embodiments of the present application can be implemented in software. The live broadcast processing device provided in the embodiments of the present application can be provided as various software embodiments, including various forms including applications, software, software modules, scripts or codes.

[0131] Figure 2 A live broadcast processing device 555 stored in a memory 550 is shown, which may be software in the form of a program or plug-in, and includes a series of modules, including a first display module 5551, an acquisition module 5552, and a second display module 5553. These modules are logical, and therefore may be arbitrarily combined or further split according to the functions implemented. The functions of each module will be described below.

[0132] As mentioned above, the video processing method provided in the embodiments of the present application can be implemented by various types of electronic devices. Figure 3 , Figure 3 is a flowchart of a live broadcast processing method provided in an embodiment of the present application, combined with Figure 3 The steps shown are explained.

[0133] It should be noted that Figure 3 The method shown can be executed by various forms of computer programs running on the terminal 200-1, and is not limited to the client running on the above-mentioned terminal 200-1, such as the above-mentioned operating system 551, software modules, scripts and applets. Therefore, the example of the client below should not be regarded as a limitation on the embodiments of the present application.

[0134] In step 101, a shooting entrance is displayed in the live broadcast room.

[0135] For example, after any account enters the live broadcast room, a shooting entrance is displayed in the live broadcast room, and the shooting entrance is used to shoot the live screen in the live broadcast stream of the live broadcast room. Among them, any account can be a viewer account, a host account, or a host's secondary account.

[0136] It should be noted that the relevant display data of the live broadcast room can be pre-stored locally in the terminal device, or can be obtained by the terminal device from the server in real time. The terminal device can display the live broadcast screen according to the relevant display data of the live broadcast room.

[0137] In step 102, in response to a trigger operation on a shooting entry, a current live broadcast picture corresponding to the current time point of the trigger operation is obtained from the live broadcast stream of the live broadcast room.

[0138] It should be noted that the embodiments of the present application do not limit the trigger operation, for example, it can be a touch operation, such as a click or long press operation, etc.; it can also be a non-touch operation, such as a gesture input operation or a voice input operation, etc. Here, upon receiving a trigger operation for the shooting entrance, the current live screen corresponding to the current time point of the trigger operation is obtained from the live stream of the live broadcast room, which means that the current live screen is a key screen in the live stream, so that the live broadcast sharing can be performed based on the key screen in the live stream, thereby improving the interaction efficiency and live broadcast effect.

[0139] like Figure 4A As shown, a "take photo" button 401 (i.e., shooting entrance) is displayed in the live broadcast room. When the user clicks the "take photo" button 401, the current live broadcast picture 402 corresponding to the current time point of the triggering operation is obtained from the live broadcast stream of the live broadcast room.

[0140] In some embodiments, before obtaining the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, the account that implements the trigger operation is obtained; when the account is an anchor account with shooting authority, it is determined that it will respond to the trigger operation of the user account on the shooting entrance.

[0141] For example, after any account enters the live broadcast room, the shooting entrance can be displayed in the live broadcast room, but not all accounts have shooting permissions. In order to ensure the orderliness of the live broadcast and avoid malicious shooting by the audience, it is set that the audience account does not have shooting permissions, and the anchor account has shooting permissions, thereby ensuring the safety of live broadcast shooting.

[0142] As an example, after a user account enters the live broadcast room and a shooting entrance is displayed in the live broadcast room, when the user triggers the shooting entrance, it is determined whether the user account is an anchor account with shooting permission. If the user account is an anchor account with shooting permission, then in response to the user account's trigger operation on the shooting entrance, the current live broadcast picture corresponding to the current time point of the trigger operation is obtained from the live broadcast stream of the live broadcast room; when the user account is not an anchor account with shooting permission, the current live broadcast picture corresponding to the current time point of the trigger operation is not obtained from the live broadcast stream of the live broadcast room, and a prompt message is displayed to prompt the user that he does not have shooting permission.

[0143] As an example, after the user account enters the live broadcast room, it is determined whether the user account is an anchor account with shooting permissions. When the user account is an anchor account with shooting permissions, a shooting entrance is displayed in the live broadcast room, and in response to the user account's trigger operation on the shooting entrance, the current live broadcast picture corresponding to the current time point of the trigger operation is obtained from the live broadcast stream of the live broadcast room; when the user account is not an anchor account with shooting permissions, the shooting entrance is not displayed in the live broadcast room, and thus the current live broadcast picture corresponding to the current time point of the trigger operation cannot be obtained from the live broadcast stream of the live broadcast room, and a prompt message is displayed to remind the user that he does not have shooting permissions.

[0144] In some embodiments, before obtaining the current live screen corresponding to the current time point of the trigger operation from the live stream of the live broadcast room, the account that implements the trigger operation is obtained; when the account does not have shooting permission, the shooting authorization entrance is displayed; wherein, the shooting authorization entrance is used to apply for shooting permission; when the account that implements the trigger operation applies for shooting permission and is approved by the anchor account, it is determined to execute the acquisition of the current live screen corresponding to the current time point of the trigger operation from the live stream of the live broadcast room.

[0145] For example, after any account enters the live broadcast room, the shooting entrance can be displayed in the live broadcast room, but not all accounts have shooting permissions. In order to ensure the orderliness of the live broadcast and avoid malicious shooting by the audience, the audience account is set not to have shooting permissions, and the anchor account has shooting permissions, so as to ensure the safety of live broadcast shooting. However, the audience account can apply for shooting authorization from the anchor account. After the anchor account agrees to the audience account's application for shooting permissions, the audience account is set to have shooting permissions, so that some audience accounts can shoot, improve the interactive initiative of the audience account, and avoid the live broadcast screen shot by the anchor not meeting the audience's needs, thereby ensuring the effectiveness of the current live broadcast screen shot, and improving the interactive efficiency and live broadcast effect.

[0146] like Fig. 8A As shown, after the viewer account enters the live broadcast room, a "take photo" button 801 (i.e., shooting entrance) is displayed in the live broadcast room. When the viewer triggers the "take photo" button 801, it is determined whether the viewer account is an anchor account with shooting authority. When the user account is not an anchor account with shooting authority, a shooting authorization entrance (for example, including a "give up" button and an "apply for authorization" button 802) is displayed. When the viewer triggers the "apply for authorization" button 802, an authorization request is sent to the anchor account. After the anchor account receives the authorization request, as shown in FIG. Figure 8B As shown, the audience's authorization request is presented on the anchor interface, and a "Give up" button and an "Agree" button 803 are displayed for the authorization request. When the anchor clicks the "Agree" button 803, the audience account has the shooting permission under the authorization of the anchor, and can also initiate taking pictures.

[0147] In some embodiments, a scheme for obtaining a current live screen corresponding to a current time point of a trigger operation from a live stream in a live broadcast room is as follows: a plurality of candidate key screens adjacent to the current time point of the trigger operation are obtained from the decoded live stream, and the plurality of candidate key screens are displayed; in response to a selection operation for the plurality of candidate key screens, the selected candidate key screen is used as the current live screen.

[0148] For example, when a user is watching a live broadcast in a live broadcast room and encounters a live broadcast scene that needs to be shot, the shooting entrance of the live broadcast room is triggered. However, when the shooting entrance is triggered, it is very likely that the live broadcast scene that needs to be shot is missed, that is, the time point of the live broadcast scene that needs to be shot does not correspond to the time point of the trigger operation, so it is necessary to find the live broadcast scene before the time point of the trigger operation as the live broadcast scene that needs to be shot. Among them, the similarity between the candidate key scenes is less than the similarity threshold, and the candidate key scene is the scene where the key action in the motion change of the character or object in the live stream is located.

[0149] As an example, during the live broadcast process, a period of live stream will be decoded and cached without re-decoding, so as to quickly respond to the trigger operation for the shooting entrance and obtain multiple candidate key pictures close to the current time point of the trigger operation from the decoded live stream. Among them, when the cache space is greater than the set threshold, the decoded live stream for a period of time (including key pictures and non-key pictures) can be cached in the cache space; when the cache space is greater than or equal to the set threshold, the key pictures in the decoded live stream for a period of time can be cached in the cache space.

[0150] It should be noted that when key frames in a decoded live stream are cached in the cache space for a period of time, multiple candidate key frames close to the current time point of the trigger operation are obtained from the decoded live stream, and multiple candidate key frames are displayed for user selection. In response to the selection operation on the multiple candidate key frames, the selected candidate key frame is used as the current live frame, so that the live frame to be shot can be accurately selected based on manual operation, thereby improving the accuracy of shooting and thus improving the accuracy of live interaction.

[0151] In some embodiments, a scheme for obtaining a current live picture corresponding to a current time point of a trigger operation from a live stream in a live broadcast room is as follows: obtaining an optimal key picture whose decoding time point is close to the current time point of the trigger operation from the decoded live stream; and using the optimal key picture as the current live picture corresponding to the current time point of the trigger operation.

[0152] It should be noted that when the cache space contains key frames in the decoded live stream for a period of time and the decoding timestamp (i.e., decoding time point) of each key frame, based on the decoding time point of each key frame in the decoded live stream, the optimal key frame whose decoding time point is close to the current time point of the triggering operation is obtained, thereby automatically determining the live frame that needs to be shot, improving the shooting efficiency, and thus improving the efficiency of live interaction.

[0153] In some embodiments, the process of acquiring the optimal key picture close to the current time point of the trigger operation is as follows: the key picture whose decoding time point is closest to the current time point of the trigger operation is acquired from the decoded live stream, and the key picture is used as the optimal key picture close to the current time point of the trigger operation.

[0154] For example, since most users watch live broadcasts in a live broadcast room, when they encounter a live broadcast scene that needs to be shot, they will trigger the shooting entrance of the live broadcast room in time. Therefore, the time point of the trigger operation is close to the time point of the live broadcast scene that needs to be shot. In this way, the decoding time point of each key picture is obtained from the decoded live stream, and the key pictures are sorted based on the decoding time of the key pictures. The key picture whose decoding time point is closest to the current time point of the trigger operation is used as the optimal key picture, thereby automatically determining the live broadcast scene that needs to be shot, improving the efficiency of shooting, and thus improving the efficiency of live interaction.

[0155] In some embodiments, the process of obtaining the optimal key picture close to the current time point of the trigger operation is as follows: obtain multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation from the decoded live stream, and obtain the interaction heat of the audience account for the multiple candidate key pictures; take the candidate key picture corresponding to the highest interaction heat as the optimal key picture.

[0156] For example, when viewers are watching a live broadcast in a live broadcast room and encounter a key screen, they will interact in a timely manner, such as liking, commenting, and forwarding. Based on the interaction data, the interaction heat of the viewer account for multiple candidate key screens can be obtained. When the interaction heat of a candidate key screen is high, it means that the candidate key screen may be a live screen that needs to be shot; when the interaction heat of a candidate key screen is low, it means that the candidate key screen may not be a live screen that needs to be shot. Therefore, the candidate key screen corresponding to the highest interaction heat is used as the optimal key screen, thereby automatically determining the live screen with high interaction heat, improving the efficiency of shooting, and thus improving the efficiency of live interaction.

[0157] In some embodiments, the process of acquiring the optimal key picture close to the current time point of the trigger operation is as follows: obtain multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation from the decoded live stream; call the quality recognition model based on the multiple candidate key pictures to obtain quality scores of the multiple candidate key pictures; and take the candidate key picture corresponding to the highest quality score as the optimal key picture.

[0158] For example, the image quality of each candidate key picture is different, for example, some pictures are incomplete (for example, for a face picture, only the side face is shown, not the front face), some pictures are blurred, some pictures are exposed, etc., so it is necessary to select high-quality candidate key pictures from multiple candidate key pictures as the live pictures that need to be shot. In this way, after obtaining multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation from the decoded live stream, the quality recognition model is called, and the quality recognition processing is performed on the multiple candidate key pictures through the quality recognition model to obtain the quality scores of the multiple candidate key pictures, and the candidate key picture corresponding to the highest quality score is used as the optimal key picture, thereby automatically determining a high-quality live picture, improving the shooting effect, and thus improving the effect of live interaction.

[0159] The quality recognition model may be a trained neural network model, and the neural network model may be trained based on live picture samples and marked quality scores. The live picture samples are subjected to quality recognition processing through the initialized quality recognition model to obtain the predicted scores of the live picture samples; based on the marked quality scores and the predicted scores, a loss function of the quality recognition model is constructed; the parameters of the quality recognition model are updated based on the loss function, and the updated parameters of the quality recognition model are used as the parameters of the trained quality recognition model, so that the quality recognition processing of the candidate key pictures is performed through the trained quality recognition model.

[0160] In some embodiments, the type of the current live broadcast screen includes one of the following: picture, video clip; wherein the thumbnail of the video clip is different from the thumbnail of the picture in display style, and the different display styles include at least one of the following: color, size, special effects.

[0161] For example, the word "Video" is displayed on the thumbnail of the video clip to distinguish it from the thumbnail of the picture; the size of the thumbnail of the video clip is larger than that of the thumbnail of the picture to distinguish it from the thumbnail of the picture; the thumbnail of the picture uses a static effect, and the thumbnail of the video clip uses an animated effect to distinguish it from the thumbnail of the picture.

[0162] In step 103, a thumbnail of the current live broadcast screen is displayed in the live broadcast room.

[0163] For example, upon receiving a trigger operation for a shooting entrance, the current live screen corresponding to the current time point of the trigger operation is obtained from the live stream of the live room, and a thumbnail of the current live screen is displayed in the live room, so that live sharing can be performed based on the thumbnail of the current live screen, thereby improving interactive efficiency and live broadcast effect.

[0164] In some embodiments, when at least one trigger operation for the shooting entrance has been received before the trigger operation, and a corresponding thumbnail of at least one historical live screen has been displayed in the live broadcast room, thumbnails of multiple live screens are arranged and displayed in the live broadcast room, wherein the multiple live screens include the current live screen and at least one historical live screen; in response to a trigger operation for any thumbnail, the live screen corresponding to any thumbnail is displayed in the live broadcast room.

[0165] For example, thumbnails of historical live broadcast screens and thumbnails of current live broadcast screens are arranged and displayed in the live broadcast room, so that live broadcast sharing can be performed based on all thumbnails. Users can view the corresponding live broadcast screens at any time to avoid missing key screens in the live broadcast.

[0166] like Figure 4B As shown, before the thumbnail 404 of the current live broadcast screen (i.e., the thumbnail shot at 8:55), there are two thumbnails of historical live broadcast screens (i.e., the thumbnail shot at 8:39 and the thumbnail shot at 8:50). The thumbnail shot at 8:39, the thumbnail shot at 8:50, and the thumbnail shot at 8:55 are arranged and displayed in the live broadcast room. In response to the trigger operation for the thumbnail shot at 8:50, the live broadcast screen corresponding to the thumbnail shot at 8:50 is displayed in the live broadcast room.

[0167] In some embodiments, when the number of live screens corresponding to multiple trigger operations is greater than a quantity threshold, thumbnails of multiple live screens are arranged and displayed in the live broadcast room, including: arranging and displaying some thumbnails of the multiple live screen thumbnails in the live broadcast room; in response to a move operation on some thumbnails, updating some thumbnails displayed in the live broadcast room according to the moving direction of the move operation.

[0168] Among them, the moving operation includes a forward moving operation and a backward moving operation. When the moving operation is a forward moving operation, the thumbnail corresponding to the live screen arranged at the back of the live screen corresponding to the partial thumbnails is displayed. When the moving operation is a backward moving operation, the thumbnail corresponding to the live screen arranged in the front of the live screen corresponding to the partial thumbnails is displayed.

[0169] It should be noted that not all thumbnails of the live screen corresponding to the trigger operation must be displayed. For example, the display space in the live broadcast room is limited, and only 3 thumbnails can be displayed. However, 5 shots have been taken, and there are 5 thumbnails. Therefore, it is displayed in the live broadcast room. Figure 4B The three thumbnails shown are as follows: Figure 4C As shown, in response to a forward move operation on the three thumbnails, thumbnails corresponding to the live screens that are arranged behind the three thumbnails are displayed (for example, including thumbnail 406); in response to a backward move operation on the three thumbnails, thumbnails corresponding to the live screens that are arranged in front of the three thumbnails are displayed (for example, including thumbnail 407), so that all thumbnails can be quickly viewed through the move operation.

[0170] In some embodiments, when the number of live screens corresponding to multiple trigger operations is greater than a quantity threshold, thumbnails of multiple live screens are arranged and displayed in the live room, including: arranging and displaying some thumbnails of the multiple live screens in the live room, and displaying an expansion entrance in the live room; in response to a trigger operation for the expansion entrance, arranging and displaying thumbnails of multiple live screens in the live room.

[0171] like Figure 4D As shown, due to the limited display space of the live broadcast room, only 3 thumbnails are displayed, but 5 shots have been taken, and 3 thumbnails of the 5 live broadcast screen thumbnails are arranged and displayed in the live broadcast room, and the expansion entrance 408 is displayed. In response to the trigger operation for the expansion entrance, the thumbnails of the 5 live broadcast screens are arranged and displayed in the live broadcast room, so that all thumbnails can be quickly viewed through the expansion entrance. Among them, the embodiment of the present application does not limit the trigger operation, for example, it can be a touch operation, such as a click or a long press operation, etc.; for example, it can be a non-touch operation, such as a gesture input operation or a voice input operation, etc.

[0172] like Figure 4D As shown, after the thumbnails of 5 live screens are arranged and displayed in the live broadcast room, a folding entrance 409 is displayed in the live broadcast room. In response to the trigger operation for the folding entrance, thumbnails of 3 live screens are arranged and displayed in the live broadcast room, thereby avoiding the thumbnails occupying the display space of the live broadcast room based on the expansion entrance.

[0173] In some embodiments, when a live broadcast screen corresponding to any thumbnail is displayed in the live broadcast room, in response to a live broadcast screen switching operation, a live broadcast screen among multiple live broadcast screens that is different from the live broadcast screen corresponding to any thumbnail is displayed in the live broadcast room; wherein each switching operation is used to trigger the display of a live broadcast screen adjacent to the live broadcast screen corresponding to any thumbnail in the arrangement of multiple live broadcast screens, or each switching operation is used to trigger the display of a live broadcast screen at a corresponding position in the arrangement of multiple live broadcast screens according to the magnitude (e.g., distance, pressure) of the switching operation.

[0174] It should be noted that the arrangement of the live screen inherits the arrangement of the thumbnails, that is, the arrangement order of the live screen corresponds to the arrangement order of the thumbnails one by one. Among them, the switching operation includes a forward switching operation and a backward switching operation. When the switching operation is a forward switching operation, the live screen arranged behind the currently displayed live screen is displayed. When the switching operation is a backward switching operation, the live screen arranged in front of the currently displayed live screen is displayed. Among them, the switching operation can be a sliding operation (the forward switching operation corresponds to the forward sliding operation, and the backward switching operation corresponds to the backward sliding operation), a clicking operation (the forward switching operation corresponds to the single-click operation, and the backward switching operation corresponds to the double-click operation), etc.

[0175] like Figure 7 As shown, after clicking thumbnail 701, live screen 702 corresponding to thumbnail 701 is displayed, and in response to the forward sliding operation, live screen 705 after live screen 702 is displayed. It should be noted that the amplitude of the switching operation corresponds to the switching position. For example, when the amplitude of the switching operation corresponds to two switching positions, the display of two live screens after live screen 702 is triggered.

[0176] In some embodiments, when thumbnails of multiple live screens are arranged and displayed in a live broadcast room, in response to a selection operation on any thumbnail, the selected thumbnail is used as the current thumbnail; in response to a position adjustment operation on the current thumbnail, the position of the current thumbnail is updated in the sorting of the thumbnails of the multiple live screens.

[0177] like Figure 4E As shown, the user clicks on thumbnail 404 to select the thumbnail shot at 8:55 from the thumbnails shot at 8:39, the thumbnails shot at 8:50, and the thumbnails shot at 8:55, and adjusts the thumbnail shot at 8:55 to the position of the thumbnail shot at 8:50, so that the thumbnail shot at 8:55 is displayed at the position of the original thumbnail shot at 8:50, and the thumbnail shot at 8:50 is displayed at the position of the original thumbnail shot at 8:55, thereby achieving dynamic adjustment of the positions of thumbnails according to user needs to facilitate viewing of thumbnails.

[0178] In some embodiments, thumbnails of multiple live broadcast screens are arranged and displayed in the live broadcast room, including: arranging and displaying thumbnails of multiple live broadcast screens in the live broadcast room according to the shooting order of the multiple live broadcast screens (for example, ascending order, descending order); or arranging and displaying thumbnails of multiple live broadcast screens in the live broadcast room according to the interaction popularity order of the multiple live broadcast screens (for example, ascending order, descending order).

[0179] In some embodiments, thumbnails of multiple live screens are arranged and displayed in the live broadcast room, including: arranging and displaying the thumbnail of the current live screen before the thumbnail of at least one historical live screen; after waiting for a period of time, displaying the thumbnails of the multiple live screens in the live broadcast room according to the shooting order or interaction heat order of the multiple live screens.

[0180] For example, when at least one trigger operation for the shooting entrance has been received before the trigger operation, and the thumbnail of at least one corresponding historical live screen has been displayed in the live broadcast room, when a new live screen (i.e., the current live screen) is received, the thumbnail of the current live screen is first arranged and displayed before the thumbnail of at least one historical live screen. After waiting for a period of time, thumbnails of multiple live screens are displayed in the live broadcast room according to the shooting order or interaction heat order of the multiple live screens, so that the thumbnail of the current live screen is arranged at the head of the team at the beginning to highlight the thumbnail of the current live screen, making it easier for users to view the new live screen.

[0181] In some embodiments, thumbnails of multiple live screens are arranged and displayed in the live broadcast room, including: updating and displaying thumbnails of multiple live screens in the live broadcast room according to the shooting order or interaction heat order of the multiple live screens; during the waiting time, the thumbnail of the current live screen adopts a display style different from that of at least one thumbnail of a historical live screen; when the waiting time is exceeded, the thumbnail of the current live screen adopts the same display style as that of at least one thumbnail of a historical live screen.

[0182] For example, when the current live screen is just shot, the order of the thumbnails is updated according to the shooting time or the interaction heat, and during the waiting time, the thumbnail of the current live screen is displayed in a different style from the thumbnail of at least one historical live screen to highlight the display for a period of time. When the waiting time is exceeded, the thumbnail of the current live screen is displayed in the same style as the thumbnail of at least one historical live screen, so that the thumbnail of the current live screen is highlighted based on different display styles at the beginning, making it easier for users to view the new live screen.

[0183] Among them, different display styles include at least one of the following: color, size, and special effects. For example, the text "new" is added to the thumbnail of the current live screen to distinguish it from the thumbnails of historical live screens; the size of the thumbnail of the current live screen is larger than the size of the thumbnail of the historical live screen to distinguish it from the thumbnails of the historical live screens; the thumbnails of the historical live screens use static effects, and the thumbnail of the current live screen uses animation effects to distinguish it from the thumbnails of the historical live screens.

[0184] In some embodiments, when a live broadcast picture corresponding to any thumbnail is displayed in the live broadcast room, an editing entrance for the live broadcast picture is displayed in the live broadcast room; in response to a trigger operation on the editing entrance, an editing interface for the live broadcast picture is displayed in the live broadcast room; in response to an editing operation on the live broadcast picture in the editing interface, the edited live broadcast picture is displayed in the live broadcast room.

[0185] like Figure 4F As shown, after the live screen corresponding to any thumbnail is displayed in the live broadcast room, an editing entry 410 for the live screen is displayed in the live broadcast room. In response to the trigger operation for the editing entry 410, an editing interface 411 for the live screen is displayed in the live broadcast room. The editing text 412 is input in the editing interface 411, and the editing text 412 is submitted. After the editing is completed, the corresponding editing text 412 is added to the live screen. Therefore, the content presented in the live broadcast room is not limited to photos and time points, and text, expressions, etc. can also be edited according to needs, thereby diversifying the display style of the live screen and improving the enthusiasm of live broadcast interaction. Among them, the editing operation is not limited to text editing, but can also be deletion, modification and other operations.

[0186] As an example, when thumbnails of multiple live screens are displayed in a live broadcast room, editing entrances for the thumbnails of the multiple live screens are displayed in the live broadcast room; in response to a trigger operation on the editing entrance, an editing interface for the multiple live screens is displayed in the live broadcast room; in response to an editing operation on a live screen in the editing interface, the edited live screen is displayed in the live broadcast room.

[0187] like Fig. 10B As shown in FIG. 1 , when the touch point coordinates are clicked on the editing entry on the thumbnail 1002, the thumbnail is automatically enlarged to the corresponding live screen 1003, and an editing interface for the live screen 1003 is presented. After the editing is completed, the corresponding editing text 1004 is added to the live screen 1003. After saving the live screen 1003 with the editing text 1004 added, the audience gesture clicks on the thumbnail 1002, identifies the click hot zone, and when the touch point coordinates are clicked on the thumbnail 1002, as shown in FIG. Fig. 10C As shown, the thumbnail is automatically enlarged into a live broadcast screen 1003 with edited text 1004 added.

[0188] In some embodiments, before the editing interface for the live broadcast screen is displayed in the live broadcast room, an account that implements the trigger operation for the editing entrance is obtained; when the account is an anchor account or an anchor sub-account with editing authority, it is determined that it will respond to the trigger operation for the editing entrance.

[0189] For example, after any account enters the live broadcast room, it can watch the live broadcast in the live broadcast room, but not all accounts have editing permissions. In order to ensure the orderliness of the live broadcast and prevent viewers from maliciously editing the live broadcast screen, the viewer account is set not to have editing permissions, and the anchor account and anchor's secondary account have editing permissions, thereby ensuring the security of live broadcast interaction.

[0190] As an example, when the live broadcast screen corresponding to any thumbnail is displayed in the live broadcast room, an editing entrance for the live broadcast screen is displayed in the live broadcast room. When the user triggers the editing entrance, it is determined whether the user account is an anchor account or an anchor sub-account with editing authority. When the user account is an anchor account or an anchor sub-account with editing authority, the editing interface for the live broadcast screen will be displayed in the live broadcast room in response to the triggering operation on the editing entrance; when the user account is not an anchor account or an anchor sub-account with editing authority, the editing interface for the live broadcast screen will not be displayed in the live broadcast room, and a prompt message will be displayed to remind the user that he does not have editing authority.

[0191] As an example, after a user account enters the live broadcast room, it is determined whether the user account is an anchor account or an anchor's secondary account with editing authority. When the user account is an anchor account or an anchor's secondary account with editing authority, an editing entrance is displayed in the live broadcast room, and in response to the user account's triggering operation on the editing entrance, an editing interface for the live broadcast screen is displayed in the live broadcast room; when the anchor account or the anchor's secondary account has editing authority, the editing entrance is not displayed in the live broadcast room, and thus the editing interface for the live broadcast screen cannot be displayed in response to the user account's triggering operation on the editing entrance, and a prompt message is displayed to remind the user that he does not have editing authority.

[0192] Of course, before the editing interface for the live broadcast screen is displayed in the live broadcast room, the account that implements the triggering operation is obtained; when the account does not have editing permission, the editing authorization entrance is displayed; among them, the editing authorization entrance is used to apply for editing permission; when the account that implements the triggering operation applies for editing permission and is approved by the anchor account or the anchor's secondary account, it is determined that the editing interface for the live broadcast screen will be displayed in the live broadcast room.

[0193] In some embodiments, when a live broadcast screen corresponding to any thumbnail is displayed in the live broadcast room, an interactive entrance for the live broadcast screen is displayed in the live broadcast room; in response to a trigger operation on the interactive entrance, an interactive interface is displayed and the input interactive information is received; and in response to a submission operation on the interactive information, the interactive information for the live broadcast screen is displayed in the live broadcast room.

[0194] Among them, the interaction of the embodiments of the present application is not limited to likes, forwarding, comments, etc.

[0195] like Figure 4GAs shown, after the live screen corresponding to any thumbnail is displayed in the live broadcast room, a forwarding entrance 413 (i.e., an interactive entrance) for the live screen is displayed in the live broadcast room. In response to the trigger operation on the forwarding entrance 413, a forwarding interface for the live screen is displayed in the live broadcast room, and the "Agree" button 414 is clicked to submit the forwarding information, and the forwarding information is sent to the live broadcast server (such as a cloud server). The live broadcast server sends the forwarding information to all accounts entering the live broadcast room to display the forwarding information for the live screen in the live broadcast room, thereby diversifying the interactive style of the live broadcast screen and improving the enthusiasm for live broadcast interaction.

[0196] In some embodiments, an interactive entrance for the thumbnail is displayed in the live broadcast room; in response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, interactive information for the thumbnail is displayed in the live broadcast room.

[0197] like Figure 4G As shown, after a thumbnail of the live broadcast screen is displayed in the live broadcast room, a forwarding entrance 415 (i.e., an interactive entrance) for the thumbnail is displayed in the live broadcast room. In response to a trigger operation on the forwarding entrance 415, a forwarding interface for the thumbnail is displayed in the live broadcast room, and the "Agree" button is clicked to submit the forwarding information, and the forwarding information is sent to the live broadcast server (such as a cloud server). The live broadcast server sends the forwarding information to all accounts entering the live broadcast room to display the forwarding information for the thumbnail in the live broadcast room, thereby diversifying the interactive style of the thumbnails and improving the enthusiasm for live broadcast interaction.

[0198] The following is an explanation of an exemplary application of the embodiments of the present application in an actual live broadcast application scenario.

[0199] In the related art, there are the following live broadcast scenarios:

[0200] Live broadcast scenario 1: When the anchor goes to see an art exhibition, he or she uses a video account to broadcast live so that friends can also watch the art exhibition online; but during the live broadcast, the anchor walks and watches while holding a mobile terminal for live broadcast. When the anchor finishes watching a work, he or she will leave the current location to watch the next work, but often the friends who are watching the anchor's live broadcast have not yet understood the previous work, or want to view some details of the previous work. Because the anchor has left the location of the previous work, the friends can no longer see the previous work.

[0201] Live broadcast scenario 2: When a teacher is giving an online class to students, due to time constraints, it is impossible for the teacher to explain every page of the PPT in detail, and some students need to read them by themselves; or some students miss key content for some reasons, so the teacher needs to take pictures of the important pages and provide them to the students for self-review.

[0202] The viewers of the above live broadcast scene are limited by time and cannot fully understand and receive the content shared by the anchor.

[0203] In order to solve the above problems, the embodiment of the present application adopts an innovative interactive method. When the host is broadcasting live, he or she takes photos of important scene nodes (such as a painting in an art exhibition or a page of PPT courseware in an online class) and deposits them in the live broadcast room in the form of a timeline. Users watching the live broadcast can view each photo according to the timeline, thereby solving the problem that viewers will miss key live content in some live broadcast scenarios. The host can share more high-quality content without being constrained by time, and the viewers can maximize the absorption of live content, thereby improving the efficiency of content delivery in live broadcasts, and improving the host's broadcast experience and the viewer's experience of watching live broadcasts.

[0204] The following introduces the innovative interaction methods provided by the present application embodiment on the host side and the audience side respectively:

[0205] During the live broadcast, the host's interaction mode is as follows:

[0206] As shown in FIG4 , during the live broadcast, the host clicks the “Take Photo” button 401 at the bottom of the screen, and the taken photo 402 (i.e., the current live broadcast screen) is displayed as a thumbnail 403 at the bottom of the screen.

[0207] like Figure 5 As shown, during the live broadcast, photos can be taken at different time points, and all the taken photos are deposited at the bottom of the live broadcast room in the form of timeline 501.

[0208] During the live broadcast, the audience interaction mode is as follows:

[0209] like Figure 6 As shown, after entering the live broadcast room, the audience clicks on the thumbnail 601 at the bottom of the live broadcast room, and the thumbnail 601 is enlarged and displayed. The live broadcast screen 602 corresponding to the thumbnail 601 is displayed in the live broadcast room. The live broadcast screen 602 can be enlarged again with the finger, and the enlarged image 603 corresponding to the live broadcast screen 602 is displayed in the live broadcast room to view the details of the photo.

[0210] like Figure 7 As shown, when multiple thumbnails are deposited on the timeline, after clicking to enlarge one of the thumbnails 701, the live screen 702 corresponding to the thumbnail 701 is displayed in the live room, and all the photos on the timeline can be viewed by sliding the live screen 702. During the sliding process, a partial screen 703 of the next photo on the timeline can be previewed first, until the live screen 705 corresponding to the thumbnail 704 adjacent to the thumbnail 701 on the timeline is displayed, wherein sliding to the left can display the live screen corresponding to the next thumbnail, and sliding to the right can display the live screen corresponding to the previous thumbnail.

[0211] It should be noted that if Fig. 8A As shown, taking photos is not limited to the anchor. Viewers can also initiate taking photos with the anchor's authorization. The photos are deposited in the viewer's live broadcast room in the form of a timeline. When watching the live broadcast, the viewer clicks the "Take Photos" button 801 at the bottom of the screen to display the authorization application interface. When the viewer clicks the "Apply for Authorization" button 802, as shown in FIG. Figure 8B As shown, the host's authorization request is presented. When the host clicks the "Agree" button 803, the viewer can also initiate taking photos with the host's authorization.

[0212] like Fig. 9A As shown, the following describes the process of taking photos from the anchor side and displaying thumbnails in the live broadcast room:

[0213] Step 11: Monitor the host's gestures to extract live screen frames (i.e., live screens).

[0214] Identify the hot area where the anchor's finger clicks. When the coordinates of the finger's click contact point are in the "take photo" button area, record the trigger time point and automatically extract the live screen frame at that time point.

[0215] Step 12: Display the time point and picture frame thumbnails at the bottom of the live broadcast room.

[0216] After successfully extracting the live screen frame, Fig. 9B As shown, a thumbnail 901 of a picture frame is displayed in the bottom area of ​​the live broadcast room, for example, the thumbnail size is n px*n px, and a corresponding time point 902 is displayed at the same time, for example, the time in the format of xx:xx. Fig. 10A As shown, if photos are taken at different time points, the thumbnails are sorted from left to right along the timeline 1001.

[0217] It should be noted that the content presented on the timeline is not limited to photos and time points, such as Fig. 10B As shown, the anchor can also add text information at the time node, identify the anchor's finger click hot zone, and when the finger click contact coordinates are at the editing entrance on the thumbnail 1002, the thumbnail is automatically enlarged to the corresponding live screen 1003 and presents the editing interface. After the editing is completed, the corresponding editing text 1004 is added to the live screen 1003. After saving the live screen 1003 with the editing text 1004 added, the viewer's gesture click on the thumbnail 1002 is monitored, and the finger click hot zone is identified. When the finger click contact coordinates are at the thumbnail 1002, as shown in FIG. Fig. 10C As shown, the thumbnail is automatically enlarged into a live broadcast screen 1003 with edited text 1004 added.

[0218] Step 13: Upload time points and picture frames.

[0219] After successfully extracting the live screen frame, upload the time point and live screen frame data to the cloud server, which then sends it to the viewer's front end.

[0220] Step 14: The time point and thumbnail are displayed on the front end to the viewer.

[0221] After the cloud server sends the time point and live screen frame data to the viewer's front end, Fig.11 As shown, the time point 1101 and the thumbnail 1102 of the picture frame are displayed at the bottom of the live broadcast room in front of the viewer.

[0222] like Fig.12 As shown, the following describes the process of viewing photos from the viewer side:

[0223] Step 21: Monitor the viewer's gesture to click on the thumbnail.

[0224] Identify the finger click hot area. When the finger click contact coordinates are in the thumbnail area, such as Fig.13 As shown, the thumbnail is automatically enlarged to the corresponding live screen 1301.

[0225] Step 22: monitor the viewer's gestures and present corresponding changes.

[0226] After the thumbnail is automatically enlarged to the corresponding live screen, when the monitoring gesture swipes up, pulls down or clicks the live screen, the photo (that is, the live screen after the thumbnail is enlarged) is folded and turned into a thumbnail, returning to the original state.

[0227] After the thumbnail is automatically enlarged to the corresponding live screen, when a zoom gesture is detected, such as Fig.14 As shown, the photo (i.e., the live broadcast picture after the thumbnail is enlarged) is enlarged following the gesture, and the enlarged picture 1401 is displayed.

[0228] After the thumbnail is automatically enlarged to the corresponding live screen, when the left and right sliding gesture is detected, it is determined whether there are adjacent thumbnails. If there are adjacent thumbnails, the adjacent thumbnails are switched to display. The switching process is as follows: Fig.15 As shown, a partial screen 1501 of the current live screen and a partial screen 1502 of the live screen corresponding to an adjacent thumbnail are displayed; when there is no adjacent thumbnail, the status quo is maintained (ie, the thumbnail is automatically enlarged to the corresponding live screen).

[0229] In summary, the embodiments of the present application can capture the images that are to be delivered to the viewers in the live broadcast scene, and deposit them in the live broadcast room in the form of a timeline. The viewers can zoom in to view the details in the photos without leaving the live broadcast room, which has the following beneficial effects:

[0230] 1) During live broadcast, the host can fully share the content with viewers within a limited time;

[0231] 2) It satisfies the need for viewers to fully receive and understand the content shared by the host without being restricted by time.

[0232] So far, the live broadcast processing method provided by the embodiment of the present application has been described in combination with the exemplary application and implementation of the terminal provided by the embodiment of the present application. The following will continue to describe the solution for implementing live broadcast processing by cooperating in each module (first display module 5551, acquisition module 5552, second display module 5553) in the live broadcast processing device 555 provided by the embodiment of the present application.

[0233] The first display module 5551 is used to display the shooting entrance in the live broadcast room; the acquisition module 5552 is used to respond to the trigger operation on the shooting entrance and obtain the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room; the second display module 5553 is used to display a thumbnail of the current live broadcast picture in the live broadcast room.

[0234] In some embodiments, when at least one trigger operation for the shooting entrance has been received before the trigger operation, and a thumbnail of at least one corresponding historical live broadcast screen has been displayed in the live broadcast room, the second display module 5553 is also used to arrange and display thumbnails of multiple live broadcast screens in the live broadcast room, wherein the multiple live broadcast screens include the current live broadcast screen and at least one historical live broadcast screen; in response to a trigger operation for any thumbnail, the live broadcast screen corresponding to any thumbnail is displayed in the live broadcast room.

[0235] In some embodiments, the second display module 5553 is also used to arrange and display some thumbnails of the multiple live screen thumbnails in the live broadcast room; in response to a move operation on the some thumbnails, the some thumbnails displayed in the live broadcast room are updated according to the moving direction of the move operation.

[0236] In some embodiments, the second display module 5553 is also used to arrange and display some of the thumbnails of the multiple live screens in the live broadcast room, and display an expansion entrance in the live broadcast room; in response to a trigger operation on the expansion entrance, the thumbnails of the multiple live screens are arranged and displayed in the live broadcast room.

[0237] In some embodiments, when the live broadcast picture corresponding to any one of the thumbnails is displayed in the live broadcast room, the second display module 5553 is also used to respond to the live broadcast picture switching operation, and display a live broadcast picture among the multiple live broadcast pictures that is different from the live broadcast picture corresponding to any one of the thumbnails in the live broadcast room; wherein each switching operation is used to trigger the display of the live broadcast picture adjacent to the live broadcast picture corresponding to any one of the thumbnails in the arrangement of the multiple live broadcast pictures, or each switching operation is used to trigger the display of the live broadcast picture at the corresponding position in the arrangement of the multiple live broadcast pictures according to the amplitude of the switching operation.

[0238] In some embodiments, when thumbnails of multiple live screens are arranged and displayed in the live broadcast room, the second display module 5553 is also used to respond to a selection operation on any one of the thumbnails and use the selected thumbnail as the current thumbnail; in response to a position adjustment operation on the current thumbnail, the position of the current thumbnail is updated in the arrangement of the thumbnails of the multiple live screens.

[0239] In some embodiments, the second display module 5553 is also used to arrange and display thumbnails of the multiple live broadcast screens in the live broadcast room according to the shooting order of the multiple live broadcast screens; or, to arrange and display thumbnails of the multiple live broadcast screens in the live broadcast room according to the interaction popularity order of the multiple live broadcast screens.

[0240] In some embodiments, the second display module 5553 is also used to arrange and display the thumbnail of the current live screen before the thumbnail of the at least one historical live screen; after waiting for a period of time, the thumbnails of the multiple live screens are displayed in the live broadcast room according to the shooting order or interaction popularity order of the multiple live screens.

[0241] In some embodiments, the second display module 5553 is also used to update and display the thumbnails of the multiple live screens in the live broadcast room according to the shooting order or interaction popularity order of the multiple live screens; during the waiting period, the thumbnail of the current live screen is displayed in a different style from the thumbnail of the at least one historical live screen; when the waiting period is exceeded, the thumbnail of the current live screen is displayed in the same style as the thumbnail of the at least one historical live screen.

[0242] In some embodiments, when a live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the device also includes: an editing module, used to display an editing entrance for the live broadcast screen in the live broadcast room; in response to a trigger operation on the editing entrance, displaying an editing interface for the live broadcast screen in the live broadcast room; in response to an editing operation on the live broadcast screen in the editing interface, displaying the edited live broadcast screen in the live broadcast room.

[0243] In some embodiments, before the editing interface for the live broadcast screen is displayed in the live broadcast room, the editing module is also used to obtain an account that implements a trigger operation on the editing entry; when the account is an anchor account or an anchor sub-account with editing authority, it is determined that it will respond to the trigger operation on the editing entry.

[0244] In some embodiments, when the live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the second display module 5553 is also used to display an interactive entrance for the live broadcast screen in the live broadcast room; in response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, the interactive information for the live broadcast screen is displayed in the live broadcast room.

[0245] In some embodiments, the second display module 5553 is also used to display an interactive entrance for the thumbnail in the live broadcast room; in response to a trigger operation on the interactive entrance, display an interactive interface and receive input interactive information; and in response to a submission operation on the interactive information, display the interactive information for the thumbnail in the live broadcast room.

[0246] In some embodiments, before obtaining the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, the acquisition module 5552 is also used to obtain the account that implements the trigger operation; when the account is an anchor account with shooting authority, it is determined to respond to the trigger operation of the user account for the shooting entrance.

[0247] In some embodiments, the acquisition module 5552 is also used to acquire the account that implements the trigger operation; when the account does not have shooting permission, a shooting authorization entrance is displayed; wherein the shooting authorization entrance is used to apply for shooting permission; when the account that implements the trigger operation applies for shooting permission and is approved by the anchor account, it is determined to obtain the current live broadcast screen corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room.

[0248] In some embodiments, the acquisition module 5552 is also used to acquire multiple candidate key pictures that are close to the current time point of the trigger operation from the decoded live stream, and display the multiple candidate key pictures; in response to a selection operation on the multiple candidate key pictures, the selected candidate key picture is used as the current live picture.

[0249] In some embodiments, the acquisition module 5552 is also used to obtain the optimal key picture whose decoding time point is close to the current time point of the trigger operation from the decoded live stream; and use the optimal key picture as the current live picture corresponding to the current time point of the trigger operation.

[0250] In some embodiments, the acquisition module 5552 is also used to obtain the key picture whose decoding time point is closest to the current time point of the trigger operation in the decoded live stream, and use the key picture as the optimal key picture close to the current time point of the trigger operation.

[0251] In some embodiments, the acquisition module 5552 is also used to obtain from the decoded live stream multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation, and obtain the interaction heat of the audience account to the multiple candidate key pictures; and take the candidate key picture corresponding to the highest interaction heat as the optimal key picture.

[0252] In some embodiments, the acquisition module 5552 is also used to obtain from the decoded live stream multiple candidate key pictures whose decoding time points are close to the current time point of the trigger operation; call the quality recognition model based on the multiple candidate key pictures to obtain the quality scores of the multiple candidate key pictures; and take the candidate key picture corresponding to the highest quality score as the optimal key picture.

[0253] In some embodiments, the type of the current live screen includes one of the following: picture, video clip; wherein the thumbnail of the video clip is different from the thumbnail of the picture in display style, and the different display styles include at least one of the following: color, size, special effects.

[0254] The embodiment of the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the live broadcast processing method described in the embodiment of the present application.

[0255] The present application embodiment provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the live broadcast processing method provided by the present application embodiment, for example, Figure 3 The live broadcast processing method is shown.

[0256] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.

[0257] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0258] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0259] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.

[0260] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A live broadcast processing method, characterized in that: The method comprises: Display the shooting entrance in the live broadcast room; In response to a trigger operation on the shooting entry, a current live picture corresponding to a current time point of the trigger operation is obtained from the live stream of the live broadcast room, and When at least one trigger operation for the shooting entrance has been received before the trigger operation, and a thumbnail of the corresponding at least one historical live screen has been displayed in the live broadcast room, a plurality of thumbnails of live screens are arranged and displayed in the live broadcast room, wherein the plurality of live screens include the current live screen and at least one of the historical live screens, and the thumbnails of the plurality of live screens are arranged and displayed in the live broadcast room, including: within the waiting time, the thumbnail of the current live screen adopts a display style different from that of the thumbnail of the at least one historical live screen, and when the waiting time is exceeded, the thumbnail of the current live screen adopts the same display style as that of the thumbnail of the at least one historical live screen; In response to a trigger operation on any thumbnail, the live broadcast screen corresponding to the any thumbnail is displayed in the live broadcast room.

2. The method according to claim 1, characterized in that The step of arranging and displaying a plurality of thumbnails of live broadcast images in the live broadcast room comprises: Arranging and displaying some thumbnails of the thumbnails of the plurality of live broadcast images in the live broadcast room; In response to a move operation on the portion of thumbnails, the portion of thumbnails displayed in the live broadcast room is updated according to a moving direction of the move operation.

3. The method according to claim 1, characterized in that The step of arranging and displaying a plurality of thumbnails of live broadcast images in the live broadcast room comprises: Arrange and display some thumbnails of the plurality of thumbnails of the live broadcast screens in the live broadcast room, and display an expansion entrance in the live broadcast room; In response to a trigger operation on the expansion entrance, thumbnails of the multiple live broadcast screens are arranged and displayed in the live broadcast room.

4. The method according to claim 1, characterized in that: When the live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the method further includes: In response to a live screen switching operation, displaying a live screen among the multiple live screens that is different from the live screen corresponding to any one of the thumbnails in the live broadcast room; Wherein, each switching operation is used to trigger the display of a live screen adjacent to the live screen corresponding to any one of the thumbnails in the arrangement of the multiple live screens, or, each switching operation is used to trigger the display of a live screen at a corresponding position in the arrangement of the multiple live screens according to the amplitude of the switching operation.

5. The method according to claim 1, characterized in that When thumbnails of a plurality of live broadcast images are arranged and displayed in the live broadcast room, the method further includes: In response to a selection operation on any one of the thumbnails, taking the selected thumbnail as a current thumbnail; In response to the position adjustment operation for the current thumbnail, the position of the current thumbnail is updated in the order in which the thumbnails of the multiple live screens are arranged.

6. The method according to claim 1, characterized in that The step of arranging and displaying a plurality of thumbnails of live broadcast images in the live broadcast room comprises: Arranging and displaying thumbnails of the plurality of live broadcast screens in the live broadcast room according to the shooting order of the plurality of live broadcast screens; or, Thumbnails of the multiple live broadcast screens are arranged and displayed in the live broadcast room according to the interaction popularity order of the multiple live broadcast screens.

7. The method according to claim 1, characterized in that The step of arranging and displaying a plurality of thumbnails of live broadcast images in the live broadcast room comprises: Arrange and display the thumbnail of the current live screen before the thumbnail of the at least one historical live screen; After the waiting period, thumbnails of the multiple live broadcast screens are displayed in the live broadcast room according to the shooting order or interaction popularity order of the multiple live broadcast screens.

8. The method according to claim 1, characterized in that The method further comprises: According to the shooting order or interaction popularity order of the multiple live broadcast screens, thumbnails of the multiple live broadcast screens are updated and displayed in the live broadcast room.

9. The method according to claim 1, characterized in that: When a live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the method further includes: Displaying an editing entrance for the live broadcast screen in the live broadcast room; In response to a trigger operation on the editing entry, displaying an editing interface for the live broadcast screen in the live broadcast room; In response to an editing operation on the live broadcast screen in the editing interface, the edited live broadcast screen is displayed in the live broadcast room.

10. The method according to claim 9, characterized in that Before displaying an editing interface for the live broadcast screen in the live broadcast room, the method further includes: Obtaining an account number for implementing a trigger operation on the editing entry; When the account is an anchor account or an anchor secondary account with editing authority, it is determined that a trigger operation for the editing entry will be responded to.

11. The method according to claim 1, characterized in that: When a live broadcast screen corresponding to any one of the thumbnails is displayed in the live broadcast room, the method further includes: Displaying an interactive entrance for the live broadcast screen in the live broadcast room; In response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, the interactive information on the live broadcast screen is displayed in the live broadcast room.

12. The method according to claim 1, characterized in that The method further comprises: Displaying an interactive entrance for the thumbnail in the live broadcast room; In response to a trigger operation on the interactive entrance, an interactive interface is displayed and input interactive information is received; and in response to a submission operation on the interactive information, the interactive information on the thumbnail is displayed in the live broadcast room.

13. The method according to claim 1, characterized in that Before acquiring the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, the method further includes: Obtaining the account number for implementing the trigger operation; When the account is an anchor account with shooting authority, it is determined that a trigger operation of the shooting entrance by the user account will be responded to.

14. The method according to claim 1, characterized in that Before acquiring the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room, the method further includes: Obtaining the account number for implementing the trigger operation; When the account does not have the permission to shoot, the shooting authorization entrance is displayed; The shooting authorization entry is used to apply for shooting permission; When the account implementing the trigger operation applies for shooting permission and is approved by the anchor account, it is determined to obtain the current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room.

15. The method according to claim 1, characterized in that The acquiring a current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room includes: Acquire multiple candidate key pictures close to the current time point of the trigger operation from the decoded live stream, and display the multiple candidate key pictures; In response to a selection operation on the plurality of candidate key pictures, the selected candidate key picture is used as the current live broadcast picture.

16. The method according to claim 1, characterized in that The acquiring a current live broadcast picture corresponding to the current time point of the trigger operation from the live broadcast stream of the live broadcast room includes: Acquire an optimal key picture whose decoding time point is close to the current time point of the trigger operation from the decoded live stream; The optimal key picture is used as the current live picture corresponding to the current time point of the trigger operation.

17. A live broadcast processing device, characterized in that: The device comprises: A first display module is used to display the shooting entrance in the live broadcast room; An acquisition module, configured to, in response to a trigger operation on the shooting entry, acquire a current live broadcast picture corresponding to a current time point of the trigger operation from the live broadcast stream of the live broadcast room; The second display module is used to arrange and display multiple thumbnails of live screens in the live broadcast room when at least one trigger operation for the shooting entrance has been received before the trigger operation and the thumbnail of the corresponding at least one historical live broadcast screen has been displayed in the live broadcast room, wherein the multiple live broadcast screens include the current live broadcast screen and at least one historical live broadcast screen, and the thumbnails of multiple live broadcast screens are arranged and displayed in the live broadcast room, including: within the waiting time, the thumbnail of the current live broadcast screen adopts a display style different from the thumbnail of the at least one historical live broadcast screen, when the waiting time is exceeded, the thumbnail of the current live broadcast screen adopts the same display style as the thumbnail of the at least one historical live broadcast screen; in response to the trigger operation for any thumbnail, the live screen corresponding to any thumbnail is displayed in the live broadcast room.

18. An electronic device, characterized in that: The electronic device comprises: A memory for storing executable instructions; The processor is used to implement the live broadcast processing method described in any one of claims 1 to 16 when executing the executable instructions stored in the memory.

19. A computer-readable storage medium, characterized in that: Executable instructions are stored, which are used to implement the live broadcast processing method described in any one of claims 1 to 16 when executed by a processor.

20. A computer program product comprising computer executable instructions or a computer program, characterized in that When the computer executable instructions or computer program are executed by a processor, the live broadcast processing method according to any one of claims 1 to 16 is implemented.

Images