Live broadcast data processing method and device, electronic equipment and storage medium

Abstract

The invention provides a live broadcast data processing method and device, electronic equipment and a storage medium, and belongs to the technical field of Internet. The live broadcast collection is automatically generated for the user. Compared with a mode of manually making the live broadcast collection, the mode of automatically generating the live broadcast collection is higher in efficiency, and the time and labor cost is greatly reduced. In the process of displaying the multimedia resources of the live broadcast on the basis of a certain template, the scheme also supports the user to edit the multimedia resources under the template, for example, materials included in the multimedia resources are presented for the user on an editing page, so that the user can edit the displayed materials conveniently. According to the processing mode, user-defined editing of the generated live broadcast collection by the user is achieved, operation is easy and convenient, the finally output live broadcast collection is better matched with user expectation, and the quality of the finally output live broadcast collection is ensured.

Description

Technical Field

[0001] The present disclosure relates to the field of Internet technologies, and in particular, to a method, an apparatus, an electronic device, and a storage medium for processing live broadcast data. Background Art

[0002] In the field of live broadcasts, video highlights, as the essence of live broadcast content, play an important role in meeting the needs of viewers, facilitating the development of live streamers, and promoting platform operation. Currently, the production of video highlights mainly relies on manual editing. However, the manual editing method has problems such as high time and labor costs and low production efficiency, and cannot meet the needs of the booming live broadcast industry nowadays. Summary of the Invention

[0003] The present disclosure provides a method, an apparatus, an electronic device, and a storage medium for processing live broadcast data. The technical solution of the present disclosure is as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a method for processing live broadcast data, including:

[0005] Displaying a first multimedia resource and an editing control of the current live broadcast;

[0006] In response to a triggering operation of a first object on the editing control, displaying an editing page; wherein, the editing page includes the first multimedia resource and a material position displayed based on a first template; the material position is used to display materials included in the first multimedia resource;

[0007] In response to an editing operation of the first object on the material, displaying the edited first multimedia resource on the editing page.

[0008] In some embodiments, in response to an editing operation of the first object on the material, displaying the edited first multimedia resource on the editing page includes:

[0009] When the first object is a live streamer object, in response to a joint editing operation of the first object and a second object on the material, displaying the edited first multimedia resource on the editing page;

[0010] wherein, the second object is an object that conducts a joint live broadcast with the first object, or the second object is an object that conducts a connection interaction with the first object.

[0011] In some other embodiments, the method further includes:

[0012] In response to a triggering operation on the editing control, displaying a prompt message; wherein, the prompt message is used to prompt whether to perform collaborative editing;

[0013] In response to a collaborative editing confirmation operation, after selecting to perform collaborative editing with the second object, send a collaborative editing request to the second object.

[0014] In some other embodiments, the method further includes:

[0015] Display a collaborative editing control on the editing page;

[0016] In response to a triggering operation on the collaborative editing control, after selecting to perform collaborative editing with the second object, send a collaborative editing request to the second object.

[0017] In some other embodiments, the method further includes:

[0018] During the collaborative editing process, display an editing record based on the editing operations of the second object on the first multimedia resource;

[0019] Wherein, the editing record is used to record the editing operations of the second object on the first multimedia resource.

[0020] In some other embodiments, in response to the collaborative editing confirmation operation or the triggering operation on the collaborative editing control, the method further includes:

[0021] Display a setting panel, which includes an object setting item, a permission setting item, and a sending method setting item;

[0022] Based on the object setting item, obtain the second object for performing collaborative editing;

[0023] Based on the permission setting item, obtain the operation permission of the second object on the first multimedia resource;

[0024] Based on the sending method setting item, obtain the sending method of the collaborative editing request.

[0025] In some other embodiments, the method further includes:

[0026] In response to a publishing operation on the editing page, publish the edited first multimedia resource;

[0027] Wherein, a collaborative editing element is added to the published first multimedia resource, and the collaborative editing element is used to indicate that the first object and the second object have completed the editing collaboratively.

[0028] In some other embodiments, the method further includes:

[0029] Display the material positions on the editing page in the playing time sequence of the materials;

[0030] Among them, the editing operation includes any one of the following:

[0031] A deletion operation on any one of the displayed video clips;

[0032] A replacement operation on any one of the displayed video clips;

[0033] A deletion operation on any one of the displayed image materials;

[0034] A replacement operation on any one of the displayed image materials.

[0035] In some other embodiments, the method further includes:

[0036] In response to the editing operation being a replacement operation on the material, display the first candidate material;

[0037] Among them, the first candidate material comes from this live broadcast;

[0038] The arrangement manner of the first candidate material includes any one of the following:

[0039] The first candidate materials are arranged according to the interaction popularity, and the interaction popularity is used to reflect the interaction effect in the live broadcast;

[0040] The first candidate materials are arranged according to the dissemination volume.

[0041] In some other embodiments, the method further includes:

[0042] Display some editing options on the editing page;

[0043] Among them, the some editing options are filtered out from all editing options based on the option usage situation.

[0044] In some other embodiments, the method further includes:

[0045] Display a switching option on the editing page;

[0046] In response to a trigger operation on the switching option, display all the editing options on the editing page.

[0047] In some other embodiments, the some editing options include a template option; the method further includes:

[0048] In response to a trigger operation on the template option, display at least one template;

[0049] In response to a selection operation on the second template among the at least one template, display the first multimedia resource based on the second template.

[0050] In some other embodiments, the method further includes:

[0051] After the first multimedia resource is selected, in response to a play operation, play the first multimedia resource based on the first template.

[0052] In some other embodiments, the displaying of the first multimedia resource and the editing control includes:

[0053] Display the first multimedia resource, the editing control, and the publishing control;

[0054] The method further includes:

[0055] After the first multimedia resource is selected, in response to a triggering operation on the publishing control, display a publishing page;

[0056] In response to a publishing operation on the publishing page, publish the first multimedia resource displayed based on the first template.

[0057] In some other embodiments, when the first object is a host object, the current live broadcast progress reaches a preset progress, including: This live broadcast has ended.

[0058] In some other embodiments, when the first object is an audience object, the current live broadcast progress reaches a preset progress, including:

[0059] The first object completes the live broadcast interaction, or, this live broadcast has ended;

[0060] Wherein, the first multimedia resource includes a live broadcast screen when the first object conducts a live broadcast interaction.

[0061] In some other embodiments, the method further includes:

[0062] In response to the editing operation being a replacement operation of the material, display the play timeline of the live broadcast replay of this session; in response to a material selection operation based on the play timeline, display the selected live broadcast replay content; or,

[0063] In response to the editing operation being a replacement operation of the material, display second candidate materials; wherein, the second candidate materials are generated based on a recording operation during the live broadcast.

[0064] In some other embodiments, the method further includes:

[0065] In response to a publishing operation on the editing page, publish the edited first multimedia resource;

[0066] Wherein, interactive elements are added to the published first multimedia resource, and the interactive elements are used to display the live broadcast screen of this session after being triggered.

[0067] In some other embodiments, the first multimedia resource and the editing control for presenting the current live broadcast include:

[0068] Presenting the first multimedia resource and the editing control in response to the current live broadcast progress reaching a preset progress; or,

[0069] During the live broadcast, presenting the first multimedia resource and the editing control in response to a target operation; or,

[0070] After the live broadcast ends, presenting the first multimedia resource and the editing control in response to the target operation.

[0071] According to a second aspect of the embodiments of the present disclosure, there is provided a processing device for live broadcast data, including:

[0072] A first presentation module configured to present a first multimedia resource and an editing control for the current live broadcast;

[0073] A second presentation module configured to present an editing page in response to a triggering operation of the first object on the editing control; wherein, the editing page includes a first multimedia resource and a material position presented based on a first template; the material position is used to present materials included in the first multimedia resource;

[0074] A third presentation module configured to present the edited first multimedia resource on the editing page in response to an editing operation of the first object on the material.

[0075] In some embodiments, the third presentation module is configured to, when the first object is a host object, present the edited first multimedia resource on the editing page in response to a joint editing operation of the first object and a second object on the material;

[0076] wherein, the second object is an object for joint live broadcast with the first object, or, the second object is an object for connection interaction with the first object.

[0077] In some other embodiments, the device further includes:

[0078] A fourth presentation module configured to present a prompt message in response to a triggering operation on the editing control; wherein, the prompt message is used to prompt whether to perform collaborative editing;

[0079] A sending module configured to send a collaborative editing request to the second object after selecting to perform collaborative editing with the second object in response to a collaborative editing confirmation operation.

[0080] In some other embodiments, the second display module is further configured to display a collaborative editing control on the editing page;

[0081] The sending module is further configured to, in response to a triggering operation on the collaborative editing control, after selecting to perform collaborative editing with the second object, send a collaborative editing request to the second object.

[0082] In some other embodiments, the device further includes:

[0083] A fifth display module, configured to display an editing record during the collaborative editing process based on the editing operation of the second object on the first multimedia resource;

[0084] Wherein, the editing record is used to record the editing operation of the second object on the first multimedia resource.

[0085] In some other embodiments, the device further includes:

[0086] A sixth display module, configured to display a setting panel in response to the collaborative editing confirmation operation or a triggering operation on the collaborative editing control, where the setting panel includes an object setting item, a permission setting item, and a sending method setting item;

[0087] A setting module, configured to obtain the second object for performing collaborative editing based on the object setting item;

[0088] The setting module is further configured to obtain the operation permission of the second object on the first multimedia resource based on the permission setting item;

[0089] The setting module is further configured to obtain the sending method of the collaborative editing request based on the sending method setting item.

[0090] In some other embodiments, the device further includes:

[0091] A publishing module, configured to publish the edited first multimedia resource in response to a publishing operation on the editing page;

[0092] Wherein, a collaborative editing element is added to the published first multimedia resource, and the collaborative editing element is used to indicate that the first object and the second object have completed the editing collaboratively.

[0093] In some other embodiments, the publishing module is further configured to publish the edited first multimedia resource in response to a publishing operation on the editing page;

[0094] Among them, an interactive element is added to the first multimedia resource after publication, and the interactive element is used to display the live broadcast screen of this live broadcast after being triggered.

[0095] In some other embodiments, the second display module is further configured to display the material positions on the editing page in the playing time sequence of the materials.

[0096] Among them, the editing operation includes any one of the following:

[0097] A deletion operation on any displayed video segment;

[0098] A replacement operation on any displayed video segment;

[0099] A deletion operation on any displayed image material;

[0100] A replacement operation on any displayed image material.

[0101] In some other embodiments, the third display module is further configured to display the first candidate materials in response to the editing operation being a replacement operation on the materials.

[0102] Among them, the first candidate materials are from this live broadcast;

[0103] The arrangement mode of the first candidate materials includes any one of the following:

[0104] The first candidate materials are arranged according to the interaction heat, and the interaction heat is used to reflect the interaction effect in the live broadcast;

[0105] The first candidate materials are arranged according to the dissemination volume.

[0106] In some other embodiments, the third display module is further configured to display the play time axis of the live broadcast replay in response to the editing operation being a replacement operation on the materials; display the selected live broadcast replay content in response to the material selection operation based on the play time axis; or,

[0107] Display the second candidate materials in response to the editing operation being a replacement operation on the materials; among them, the second candidate materials are generated based on the recording operation during the live broadcast.

[0108] In some other embodiments, the second display module is further configured to display some editing options on the editing page; among them, the some editing options are screened out from the full set of editing options based on the option usage.

[0109] In some other embodiments, the second display module is further configured to display a switching option on the editing page; in response to a triggering operation on the switching option, display the full - scale editing option on the editing page.

[0110] In some other embodiments, the partial editing options include a template option;

[0111] The third display module is configured to display at least one template in response to a triggering operation on the template option; in response to a selection operation on a second template among the at least one template, display the first multimedia resource based on the second template.

[0112] In some other embodiments, the apparatus further includes:

[0113] A playback module, configured to, after the first multimedia resource is selected, in response to a playback operation, play the first multimedia resource based on the first template.

[0114] In some other embodiments, the second display module is configured to display the first multimedia resource, the editing control, and the publishing control;

[0115] The apparatus further includes:

[0116] A seventh display module, configured to, after the first multimedia resource is selected, display a publishing page in response to a triggering operation on the publishing control;

[0117] The publishing module is further configured to publish the first multimedia resource displayed based on the first template in response to a publishing operation on the publishing page.

[0118] In some other embodiments, when the first object is a host object, the current live - broadcast progress reaching a preset progress includes: the current live - broadcast has ended.

[0119] In some other embodiments, when the first object is an audience object, the current live - broadcast progress reaching a preset progress includes:

[0120] The first object completes the live - broadcast interaction, or, the current live - broadcast has ended;

[0121] Wherein, the first multimedia resource includes a live - broadcast picture when the first object conducts a live - broadcast interaction.

[0122] In some other embodiments, the first display module is configured to:

[0123] In response to the current live - broadcast progress reaching a preset progress, display the first multimedia resource and the editing control; or,

[0124] During the live broadcast, in response to a target operation, display the first multimedia resource and the editing control; or,

[0125] After the live broadcast ends, in response to the target operation, display the first multimedia resource and the editing control.

[0126] According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, which includes:

[0127] One or more processors;

[0128] A memory for storing program code executable by the processor;

[0129] Wherein, the processor is configured to execute the program code to implement the above-mentioned method for processing live broadcast data.

[0130] According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium. When the program code in the computer-readable storage medium is executed by a processor of an electronic device, the electronic device can execute the above-mentioned method for processing live broadcast data.

[0131] According to a fifth aspect of the embodiments of the present disclosure, there is provided a computer program product, including a computer program, which implements the above-mentioned method for processing live broadcast data when executed by a processor of an electronic device.

[0132] The solution for processing live broadcast data provided by the embodiments of the present disclosure realizes automatically generating a live broadcast highlights for users. Compared with the way of manually making live broadcast highlights, this way of automatically generating live broadcast highlights is more efficient, greatly reducing the time and labor costs, and can meet the needs of the booming live broadcast industry nowadays. During the process of displaying the multimedia resources of this live broadcast based on a certain template, this solution also supports users to edit the multimedia resources under this template. For example, the materials included in the multimedia resources are presented to the users on the editing page, so as to facilitate the users to edit the displayed materials. This processing method realizes the user's custom editing of the generated live broadcast highlights, which is not only easy to operate, but also makes the finally output live broadcast highlights more in line with the user's expectations, ensuring the quality of the finally output live broadcast highlights.

[0133] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0134] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure, and do not constitute an improper limitation to the present disclosure.

[0135] Figure 1 It is a schematic diagram of the implementation environment of a method for processing live broadcast data shown according to an exemplary embodiment.

[0136] Figure 2 It is a flowchart of a method for processing live broadcast data shown according to an exemplary embodiment.

[0137] Figure 3 It is a schematic diagram of a page shown according to an exemplary embodiment.

[0138] Figure 4 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0139] Figure 5 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0140] Figure 6 It is a flowchart of another method for processing live broadcast data shown according to an exemplary embodiment.

[0141] Figure 7 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0142] Figure 8 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0143] Figure 9 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0144] Figure 10 It is another schematic diagram of a page shown according to an exemplary embodiment.

[0145] Figure 11 It is a flowchart of another method for processing live broadcast data shown according to an exemplary embodiment.

[0146] Figure 12 It is a block diagram of a device for processing live broadcast data shown according to an exemplary embodiment.

[0147] Figure 13 It is a block diagram of a terminal shown according to an exemplary embodiment. Detailed implementation manners

[0148] In order to enable those of ordinary skill in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0149] It should be noted that the terms "first", "second", etc. in the specification, claims and the above-mentioned drawings of the present disclosure are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described here can be implemented in an order other than those illustrated or described here. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0150] The information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the present disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions.

[0151] Figure 1 It is a schematic diagram of the implementation environment of a method for processing live broadcast data shown according to an exemplary embodiment.

[0152] See Figure 1 , the implementation environment includes: a terminal 101 and a server 102. Among them, the terminal 101 is an electronic device used by the user. In the embodiments of the present disclosure, a target application program is installed on the terminal 101, and the terminal 101 implements the method for processing live broadcast data provided in the embodiments of the present disclosure based on the target application program. Exemplarily, the target application program is an application program with a live broadcast function, such as an instant messaging application program, a shopping application program, a game application program or a short video application program, and the present disclosure does not make any limitations in this regard.

[0153] In some embodiments, the type of the terminal 101 is a device such as a smart phone or a tablet computer. Figure 1 Only the terminal 101 being a smart phone is taken as an example for illustration. In addition, those skilled in the art can know that the number of the above-mentioned terminals can be more or less. For example, the above-mentioned terminals can be only a few, or the above-mentioned devices can be dozens or hundreds, or a larger number, and the embodiments of the present disclosure do not make any limitations on the number and type of the terminals.

[0154] Among them, the server 102 is used to provide background services for the target application. In addition, the server 102 is connected to the terminal 101 through a wireless network or a wired network.

[0155] In some other embodiments, the server 102 is at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Of course, the server 102 may further include other functional servers to provide more comprehensive and diverse services. Exemplarily, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, a distributed computing architecture is adopted between the server 102 and the terminal 101 for collaborative computing, and the present disclosure does not limit this.

[0156] In the field of live streaming, currently the production of video highlights mainly relies on manual editing. However, the manual editing method has problems such as high time and labor costs and low production efficiency. For example, it is necessary to manually edit and splice multiple video segments, which is very time-consuming and laborious. In addition, affected by the personal preferences and judgments of editors, the video highlights produced by different editors may vary greatly in content, lacking objectivity and consistency, and thus may affect the audience's perception of the real live situation. In addition, the threshold of the manual editing method is relatively high, which greatly tests the professional skills and experience of editors. Therefore, the quality of video highlights will fluctuate due to different editors. Considering the above problems, the embodiments of the present disclosure provide a processing solution for live streaming data, realizing the automatic generation of live highlights in the field of live streaming without manual production of live highlights.

[0157] The following provides a detailed introduction to the processing solution for live streaming data provided by the embodiments of the present disclosure through the following embodiments.

[0158] Figure 2 is a flowchart of a method for processing live streaming data shown according to an exemplary embodiment. As Figure 2 shown, the method for processing live streaming data is applied to an electronic device, such as Figure 1 the terminal 101 shown. Among them, the terminal 101 is the terminal used by the first object, and the method for processing live streaming data includes the following steps:

[0159] In 201, the electronic device displays the first multimedia resource and the editing control of the current live stream.

[0160] The embodiments of the present disclosure support both automatically entering the process of generating and editing live highlights under certain conditions and the user triggering the above process by themselves, and the present disclosure does not limit this. In addition, for the way the user triggers the above process by themselves, the embodiments of the present disclosure support both the user triggering the above process during the live stream and the user triggering the above process after the live stream ends, and the present disclosure also does not limit this. Based on the above description, displaying the first multimedia resource and the editing control of the current live stream includes:

[0161] In response to the current live broadcast progress reaching a preset progress, display a first multimedia resource and an editing control; or,

[0162] During the live broadcast, in response to a target operation, display a first multimedia resource and an editing control; or,

[0163] After the live broadcast ends, in response to a target operation, display a first multimedia resource and an editing control.

[0164] Among them, the preset progress can be 100% (i.e., the live broadcast ends) or less than 100% (i.e., during the live broadcast), for example, the live broadcast progress reaches 50%. The present disclosure does not limit this. In other words, a live broadcast highlight of the current live broadcast can be generated either after the live broadcast ends or during the live broadcast. In addition, the above-mentioned target operation can be either a triggering operation on a virtual control or a preset gesture operation. The present disclosure does not limit this.

[0165] As an example, during the live broadcast, a virtual control for generating a live broadcast highlight is displayed on the live broadcast interface. In response to a triggering operation on the virtual control, the above process is entered. Or, after the live broadcast ends, the virtual control is displayed on the live broadcast end page. In response to a triggering operation on the virtual control, the above process is entered.

[0166] In summary, the embodiments of the present disclosure support both automatic generation of live broadcast highlights and generation of live broadcast highlights according to user needs, meeting the diverse needs of users, expanding the generation trigger conditions of live broadcast highlights, and having a good human-computer interaction effect. In addition, for the user-initiated triggering method, the user can trigger either during the live broadcast or after the live broadcast ends, without strict time restrictions, further improving the human-computer interaction effect. In addition, the user can trigger the generation of live broadcast highlights by performing simple operations, and the human-computer interaction efficiency is high.

[0167] In some embodiments, when the first object is the host object, the current live broadcast progress reaching the preset progress includes: the current live broadcast has ended.

[0168] In other embodiments, when the first object is the audience object, the current live broadcast progress reaching the preset progress includes: the first object completes the live broadcast interaction, or, the current live broadcast has ended. Among them, the live broadcast interaction methods include but are not limited to: sending bullet comments in the live broadcast room, giving virtual gifts to the host object, or performing a like operation in the live broadcast room, etc. The present disclosure does not limit this.

[0169] In some embodiments, different multimedia resources are used to display the highlights of the live broadcast using different templates. In other words, the embodiments of the present disclosure apply templates to display the highlights of the live broadcast, and this display method can significantly enhance the user's visual experience. Among them, the number of generated highlights can be one or multiple. If the number of generated highlights is one, then different multimedia resources are used to apply different templates to display the same highlight. If the number of generated highlights is multiple, then for any two multimedia resources, these two multimedia resources can either apply different templates to display the same highlight or apply different templates to display different highlights, and the present disclosure does not limit this.

[0170] In other embodiments, the highlights of the live broadcast can be generated in the following manner: First, multiple segments of exciting videos related to the live broadcast are generated, and then the highlights of the live broadcast are generated by automatically editing these exciting videos. Among them, the exciting videos can be determined based on various factors such as the attractiveness, topicality, or importance of the content to the live broadcast. For example, it can be determined whether a live broadcast segment is exciting from dimensions such as content, interaction, or dissemination. The present disclosure does not limit this.

[0171] In other embodiments, as Figure 3 shown, the multimedia resources are in the form of cards and are displayed on the live broadcast end page in a horizontal tiled manner. Among them, Figure 3 three multimedia resources are shown, corresponding to Card 1, Card 2, and Card 3 respectively. Card 2 is centered and corresponds to the first multimedia resource selected by the first object. As an example, the cover image and play control of the first multimedia resource are displayed on Card 2. The present disclosure does not limit this.

[0172] In addition, the embodiments of the present disclosure also support the first object to select different multimedia resources through a sliding operation. As Figure 4 shown, in response to the first object performing a left sliding operation, the centered Card 2 gradually slides to the left, and Card 3 gradually slides out from the right edge of the page. If the sliding operation is terminated when Card 3 is centered, it is considered that the first object selects the multimedia resource presented by Card 3. In addition, the size of the card also changes during the sliding process. For example, the size of the card is the largest when it is centered, and gradually decreases as it moves away from the centered position and gradually increases as it approaches the centered position. The present disclosure does not limit this.

[0173] Of course, in addition to being displayed in the form of cards, the multimedia resources can also be displayed in other forms, and the present disclosure does not limit this. In addition, in addition to the horizontal tiled manner, at least one multimedia resource can also be displayed on the live broadcast end page in other layout manners, and the present disclosure also does not limit this.

[0174] In addition, in addition to multimedia resources, Figure 3 an editing control 11 and a publishing control 22 are also displayed on the shown live end page. Among them, the editing control 11 is used to guide the first object to edit the first multimedia resource currently displayed, and the publishing control 22 is used to guide the first object to directly publish the first multimedia resource currently displayed as a work. For how to edit the first multimedia resource and how to publish the first multimedia resource, please refer to the description later.

[0175] In 202, in response to the triggering operation of the first object on the editing control, the electronic device displays an editing page; wherein, the editing page includes the first multimedia resource and a material position displayed based on the first template; the material position is used to display the materials included in the first multimedia resource.

[0176] In the embodiments of the present disclosure, if the first object selects the first multimedia resource among at least one multimedia resource, in response to the triggering operation of the first object on the editing control, the electronic device will display an editing page, such as Figure 3 jumping from the shown live end page to Figure 5 the shown editing page. The editing page includes the first multimedia resource and at least one material position displayed based on the first template. Among them, the material position is used to display the materials included in the first multimedia resource. Refer to Figure 5 , Figure 5 Only 4 materials are exemplarily shown in, which are Material 1 to Material 4 respectively. The first object can view more materials by performing a sliding operation, and the present disclosure does not limit this.

[0177] In some embodiments, the electronic device displays this material position on the editing page in the playing time sequence of the materials, and the present disclosure does not limit this.

[0178] It should be noted that the types of materials include video clips and image materials. For example, it includes multiple video clips, or for example, it includes multiple image materials, or for example, it includes both video clips and image materials. In addition, when displaying a video clip, the duration of each video clip can also be displayed, and the present disclosure does not limit this.

[0179] In other embodiments, the editing page is an editing page with streamlined functions, and only the commonly used editing functions are exposed. That is, the method provided by the embodiments of the present disclosure further includes: displaying some editing options on the editing page. Among them, this part of editing options is filtered out from the full set of editing options based on the option usage situation. For example, based on whether the option is frequently used, the top N frequently used editing options are filtered out from the full set of editing options, and these N editing options are displayed on the editing page as shown in Figure 5 . Among them, the value of N is a positive integer.

[0180] As an example, as Figure 5 shown, these editing options include: cropping options, template options, text options, and sticker options. Among them, for the function introduction of the template options, please refer to the following text.

[0181] In some other embodiments, a switching option is also displayed on the editing page. In response to a triggering operation of a first object on the switching option, the electronic device displays full editing options on the editing page. That is, the editing page with streamlined functions is restored to the initial editing page.

[0182] In 203, in response to an editing operation of a first object on the materials included in the first multimedia resource, the electronic device displays the edited first multimedia resource on the editing page.

[0183] It should be noted that the embodiments of the present disclosure support the first object to delete or replace the materials included in the first multimedia resource. In some embodiments, the above editing operations include any one of the following:

[0184] A deletion operation on any displayed video segment;

[0185] A replacement operation on any displayed video segment;

[0186] A deletion operation on any displayed image material;

[0187] A replacement operation on any displayed image material.

[0188] In summary, the processing solution for live broadcast data provided by the embodiments of the present disclosure realizes automatically generating a live broadcast highlights for users. Compared with the way of manually making live broadcast highlights, this automatic generation method is more efficient, greatly reducing the time and labor costs, and can meet the needs of the booming live broadcast industry nowadays. During the process of displaying the multimedia resources of this live broadcast based on a certain template, this solution also supports users to edit the multimedia resources under this template. For example, the materials included in this multimedia resource are presented to the user on the editing page, so as to facilitate the user to edit the displayed materials. This processing method realizes the user's custom editing of the generated live broadcast highlights, which is not only easy to operate, but also makes the finally output live broadcast highlights more in line with the user's expectations, ensuring the quality of the finally output live broadcast highlights.

[0189] In addition, this solution will display a material position on the editing page, which is used to display the materials included in the first multimedia resource. This greatly facilitates the user to edit any material, and the human-computer interaction efficiency is high. In addition, the materials displayed in the material position are arranged in an orderly manner according to the playing time sequence, which further facilitates the user to edit the materials and improves the human-computer interaction efficiency. In addition, this solution also supports the user to delete or replace video clips or image materials, etc., so as to facilitate the user to delete or replace the unsatisfactory materials in the first multimedia resource, which not only improves the human-computer interaction efficiency, but also reduces the difference between the live highlights and the user's expectations.

[0190] In addition, by displaying some editing options on the editing page, it is ensured that the editing options do not occupy too much space on the editing page, and the display effects of the first multimedia resource and the material position are ensured. In addition, the user can switch from the editing page with streamlined functions to the initial editing page with one-key operation, and the human-computer interaction efficiency is high.

[0191] In addition, this solution can generate live highlights for both the host in the live broadcast room and the audience in the live broadcast room, and has strong universality. In addition, the live highlights can be generated either after the live broadcast ends or during the live broadcast. For example, for the audience side, the live highlights can be generated for the audience after the audience completes the live interaction with the host. This processing method makes the generation of the live highlights more flexible.

[0192] The above Figure 2 The above only shows the basic process of the present disclosure. Next, based on a specific implementation manner, the solution provided by the present disclosure will be further elaborated. Figure 6 is a flowchart of another method for processing live data shown according to an exemplary embodiment. As shown in Figure 6 shown, this method for processing live data is applied to an electronic device, such as the terminal 101 shown in Figure 1 shown. Among them, the terminal 101 is the terminal used by the first object. Taking the first object as the host in the live broadcast room as an example, this method for processing live data includes the following steps:

[0193] In 601, in response to the end of the live broadcast, the electronic device displays at least one multimedia resource, an editing control, and a publishing control.

[0194] As an example, among the at least one multimedia resource, different multimedia resources are used to display the first multimedia resource of this live broadcast using different templates.

[0195] In 602, after the first object selects the first multimedia resource, in response to the playing operation of the first object, the electronic device plays the first multimedia resource based on the first template.

[0196] Embodiments of the present disclosure support a first object to preview the template effect, which facilitates the first object to determine whether to edit the first multimedia resource displayed based on the first template next or directly publish it as a work, with high human-computer interaction efficiency.

[0197] As an example, the electronic device plays the first multimedia resource on a newly opened page based on the first template. Refer to Figure 3 , in response to the triggering operation of the first object on the playback control shown in Card 2, the electronic device will open a new page as shown in Figure 7 and play the first multimedia resource on the new page shown in Figure 7 .

[0198] As another example, the electronic device plays the first multimedia resource within a floating window based on the first template. Refer to Figure 3 , in response to the triggering operation of the first object on the playback control shown in Card 2, the electronic device will display a floating window on the live end page and play the first multimedia resource within this floating window.

[0199] In 603, in response to the publishing operation of the currently played first multimedia resource, the electronic device publishes the first multimedia resource based on the first template.

[0200] As an example, as shown in Figure 7 , in response to the triggering operation of the first object on the "Go to Publish" control, the electronic device detects the publishing operation of the currently played first multimedia resource and then jumps to the publishing page as shown in Figure 8 . After adding information such as topics and descriptions on the publishing page shown in Figure 8 , by triggering the "Publish" control shown in Figure 8 , the first multimedia resource based on the first template can be published.

[0201] In 604, after the first object selects the first multimedia resource, in response to the triggering operation of the first object on the publishing control, the electronic device displays the publishing page; in response to the publishing operation on this publishing page, the electronic device publishes the first multimedia resource displayed based on the first template.

[0202] Embodiments of the present disclosure also support the first object to directly publish the first multimedia resource as a work through the publishing control. Since the first object can directly publish the first multimedia resource as a work by simply pressing a button to bring up the publishing page, the human-computer interaction efficiency is high.

[0203] As an example, as shown in Figure 3 , in response to the triggering operation of the first object on the publishing control 22, the electronic device will directly jump to the publishing page as shown in Figure 8 . InFigure 8 After adding information such as a topic and a description to the shown release page, in response to a first object triggering Figure 8 the "Release" control shown in [reference], the electronic device detects a release operation on this release page, and then releases a first multimedia resource based on a first template.

[0204] In 605, after the first object selects the first multimedia resource, in response to a triggering operation of the first object on the editing control, the electronic device displays an editing page; wherein, the first multimedia resource and a material position shown based on the first template are included on the editing page; the material position is used to display the materials included in the first multimedia resource.

[0205] This step can refer to the aforementioned step 202 and will not be elaborated here.

[0206] In 606, in response to an editing operation of the first object on the materials included in the first multimedia resource, the electronic device displays the edited first multimedia resource on this editing page.

[0207] The first point to note is that if the live broadcast mode of this live broadcast is a joint live broadcast, or, the host conducts a connection interaction during the live broadcast, then the embodiments of the present disclosure also support multiple people to perform collaborative editing on the first multimedia resource.

[0208] Among them, the connection interaction includes but is not limited to: the local host conducts a co-hosting PK with the host in other live broadcast rooms, and the host conducts a live connection with the audience in the live broadcast room. The present disclosure does not make any limitations in this regard.

[0209] To sum up, in the case where the first object is a host object, in response to a joint editing operation of the first object and the second object on the materials shown in this material position, the electronic device displays the edited first multimedia resource on this editing page. Among them, the second object is an object that conducts a joint live broadcast with the first object, or, the second object is an object that conducts a connection interaction with the first object.

[0210] The second point to note is that the number of second objects can be either one or multiple.

[0211] Among them, in the case where there are multiple people participating in the live broadcast, the embodiments of the present disclosure also support the host to invite other hosts participating in this live broadcast or the audience who conducts a live connection with the host to perform collaborative editing on the first multimedia resource. Since this processing method aggregates the editing requirements of each user participating in this live broadcast, the finally output first multimedia resource is more in line with the user's expectations, ensuring the quality of the finally output first multimedia resource.

[0212] In some embodiments, the embodiments of the present disclosure support sending a collaborative editing request to the second object in the following two ways.

[0213] Method 1: In response to a trigger operation on an editing control, a prompt message is displayed; wherein, the prompt message is used to prompt whether to perform collaborative editing; in response to a collaborative editing confirmation operation, after selecting to perform collaborative editing with a second object, a collaborative editing request is sent to the second object.

[0214] For this method, after the first object triggers the editing control 11, the electronic device directly displays a prompt message on the live end page. Exemplarily, this prompt message is in the form of a bubble, and the present disclosure does not limit this. Additionally, the bubble displays text and two options, which are a confirmation option and a negative option respectively. In response to the trigger operation of the first object on the confirmation option, the electronic device detects a collaborative editing confirmation operation. After the first object selects to perform collaborative editing with the second object, the electronic device sends a collaborative editing request to the second object.

[0215] Method 2: The editing page further includes a collaborative editing control; correspondingly, in response to a trigger operation on the collaborative editing control, after selecting to perform collaborative editing with a second object, a collaborative editing request is sent to the second object.

[0216] For this method, after the electronic device switches from the live end page to the editing page, the electronic device will display a collaborative editing control on the editing page. In response to the trigger operation of the first object on the collaborative editing control, after the first object selects to perform collaborative editing with the second object, the electronic device sends a collaborative editing request to the second object.

[0217] In summary, the embodiments of the present disclosure support multiple ways to send collaborative editing requests to other users, which enriches the implementation methods of collaborative editing. Additionally, the operation paths of these two methods are short, and the host does not need to perform complex operations to trigger a collaborative editing request, resulting in high human-computer interaction efficiency.

[0218] In some other embodiments, in response to a collaborative editing confirmation operation or a trigger operation on the collaborative editing control, the electronic device will display a settings panel. Among them, this settings panel includes a display object setting item, a permission setting item, and a sending method setting item. The electronic device obtains the second object for performing collaborative editing based on the object setting item, obtains the operation permission of the second object for the first multimedia resource based on the permission setting item, and obtains the sending method of the collaborative editing request based on the sending method setting item.

[0219] Exemplarily, the operation permission of the second object for the first multimedia resource includes, but is not limited to: the viewing permission of the first multimedia resource, the editing permission, the permission to prohibit the second object from sharing the first multimedia resource with others, etc., and the present disclosure does not limit this. Additionally, the sending methods include in-application sending methods, out-of-application sending methods, sending in the form of a web link, sending in the form of a graphic code, etc., and the present disclosure also does not limit this.

[0220] Among them, the embodiments of the present disclosure support the host to perform relevant settings for collaborative editing through the setting panel, which not only provides a basic guarantee for the host to perform collaborative editing with others, but also facilitates the host to complete the setting operation flexibly and quickly, with high human-computer interaction efficiency.

[0221] In some other embodiments, during the collaborative editing process, the electronic device will also display an editing record for the first object based on the editing operation of the second object on the first multimedia resource; wherein, the editing record is used to record the editing operation of the second object on the first multimedia resource. This display method enables the first object to quickly and clearly identify the modifications made by the second object to the first multimedia resource, with high human-computer interaction efficiency.

[0222] In some other embodiments, in response to the editing operation on the material being a deletion operation on the material, the electronic device will delete this material from the first multimedia resource.

[0223] As an example, as Figure 9 shown, if the first object selects Material 1, the electronic device will display two controls above Material 1, namely a material replacement control and a deletion control. In response to the triggering operation of the first object on the deletion control, the electronic device detects the deletion operation on Material 1 and deletes Material 1 from the first multimedia resource. Among them, the first object selects a certain material as shown in Figure 9 by performing a click operation or a long-press operation, and the present disclosure does not limit this. In addition, the material replacement control and the deletion control can be presented in the form of bubbles, and the present disclosure also does not limit this.

[0224] In some other embodiments, in response to the editing operation on the material being a replacement operation on the material, the electronic device will replace this material in the first multimedia resource and display the material selected by the user at the time point or position of this material.

[0225] As an example, in response to the triggering operation of the first object on the Figure 9 material replacement control in, the electronic device detects the replacement operation on Material 1 and will display the first candidate material. Among them, the materials in the first candidate material come from the current live broadcast. In some other embodiments, the arrangement method of the first candidate materials includes any one of the following:

[0226] 1. The first candidate materials are arranged according to the interaction heat. Among them, the interaction heat is used to reflect the interaction effect in the live broadcast. Exemplarily, the interaction heat can be statistically calculated by multiple factors such as the number of likes, the number of follows, the number of bullet screens, the number of gift-giving people, or the value of gifts, and the present disclosure does not limit this.

[0227] 2. The first candidate materials are arranged according to the dissemination volume. Exemplarily, the dissemination volume is the number of reposts, and the present disclosure does not limit this.

[0228] In summary, during the material replacement process, the embodiments of the present disclosure support displaying the first candidate materials in multiple ways, which not only enriches the material display methods, but also facilitates the user to quickly select new materials from the candidate materials, improving the human-computer interaction efficiency.

[0229] In some other embodiments, the embodiments of the present disclosure also support automatically intercepting materials for material replacement after the live broadcast ends. That is, in response to an editing operation on the material being a replacement operation for the material, the embodiments of the present disclosure support displaying the playback timeline of the live broadcast of this session. In response to the user's material selection operation based on this playback timeline, the electronic device will display the selected live broadcast playback content to facilitate the user's selection. In addition, the embodiments of the present disclosure also support the user to obtain materials during the live broadcast, that is, in response to an editing operation on the material being a replacement operation for the material, the embodiments of the present disclosure support displaying the second candidate materials. Among them, the second candidate materials are generated based on the recording operation during the live broadcast. This way of obtaining materials enriches the user's material replacement methods and improves the human-computer interaction efficiency.

[0230] In some other embodiments, the embodiments of the present disclosure also support the first object to replace the template on the editing page. In response to the first object triggering the Figure 6 template option shown in, the electronic device will display at least one template. Refer to Figure 10 , Figure 10 In, only 4 templates are exemplarily shown, namely Template 1 to Template 4. The first object can view more templates by performing a sliding operation, and the present disclosure does not limit this. Next, in response to the first object's selection operation on the second template among at least one template, the electronic device will display the first multimedia resource on the editing page based on the second template.

[0231] As an example, the templates can be displayed classified or unclassified on the editing page, depending on the operation of the first object, and the present disclosure does not limit this.

[0232] In summary, after entering the editing process, the embodiments of the present disclosure also support the first object to replace the template of the first multimedia resource, with high flexibility and enriching the editing methods of the first multimedia resource.

[0233] In 607, in response to a publishing operation on the editing page, the electronic device publishes the edited first multimedia resource.

[0234] In some other embodiments, for the case of collaborative editing, in response to a publishing operation on the editing page, the electronic device adds a collaborative editing element to the first multimedia resource being published, where the collaborative editing element is used to indicate that the first object and the second object have collaborated to complete the editing.

[0235] As an example, the editing element can be an identifying information that runs through the first multimedia resource, or other iconic information added to the cover of the first multimedia resource. The present disclosure does not limit this. Adding a collaborative editing element to the published live highlights enables users who view the first multimedia resource in the content consumption scenario to quickly identify the editors related to this first multimedia resource through this collaborative editing element, ensuring information transparency.

[0236] In some other embodiments, in response to a publishing operation on the editing page, the electronic device publishes the edited first multimedia resource. Among them, an interaction element is added to the published first multimedia resource, and the interaction element is used to display the live video of this live broadcast after being triggered. That is, with one key operation, other users can enter the live broadcast room to watch the live broadcast, improving the efficiency of human-computer interaction.

[0237] In summary, the processing solution for live broadcast data provided by the embodiments of the present disclosure realizes automatically generating live highlights for users. Compared with the method of manually producing live highlights, this automatic generation method of live highlights is more efficient, greatly reducing the time and labor costs, and can meet the needs of the booming live broadcast industry nowadays. In addition, this solution also applies different templates to display the live highlights of this live broadcast, and the video effect is good. In addition, after the user selects a certain template, this solution also supports the user to edit the live highlights under this template. For example, visual materials in the live highlights are presented to the user on the editing page so that the user can edit the displayed visual materials. This processing method realizes the user's custom editing of the generated live highlights, which is not only easy to operate, but also makes the finally output live highlights more in line with the user's expectations, ensuring the quality of the finally output live highlights.

[0238] The above Figure 2 only shows the basic process of the present disclosure. Next, based on a specific implementation method, the solution provided by the present disclosure will be further elaborated. Figure 11 is a flowchart of another method for processing live broadcast data shown according to an exemplary embodiment. As Figure 11 shown, this method for processing live broadcast data is applied to an electronic device, such as Figure 1 the terminal 101 shown. Among them, the terminal 101 is the terminal used by the first object. Taking the first object as an audience in the live broadcast room as an example, this method for processing live broadcast data includes the following steps:

[0239] In 1101, in response to a first object completing a live interaction, the electronic device displays at least one multimedia resource, an editing control, and a publishing control.

[0240] For the audience side, in addition to generating a first multimedia resource immediately after the audience completes the live interaction, a first multimedia resource may also be generated after the live broadcast ends. The present disclosure does not limit this. Additionally, the first multimedia resource generated for the first object includes the live broadcast screen during the live interaction of the first object.

[0241] In 1102, after the first object selects the first multimedia resource, in response to the play operation of the first object, the electronic device plays the first multimedia resource based on the first template.

[0242] This step can refer to the aforementioned step 602 and will not be elaborated here.

[0243] In 1103, in response to the publishing operation on the currently played first multimedia resource, the electronic device publishes the first multimedia resource based on the first template.

[0244] This step can refer to the aforementioned step 603 and will not be elaborated here.

[0245] In 1104, after the first object selects the first multimedia resource, in response to the trigger operation of the first object on the publishing control, the electronic device displays a publishing page; in response to the publishing operation on this publishing page, the electronic device publishes the first multimedia resource displayed based on the first template.

[0246] In some embodiments, an interaction element is added to the first multimedia resource published by the audience. Among them, this interaction element is used to link to the live broadcast room after being triggered in the content consumption scenario. In other words, a user watching the first multimedia resource can enter the live broadcast room with one click through this interaction element. As an example, a specific interaction element is an operation entry displaying the words "The anchor is live broadcasting", and the present disclosure does not limit this.

[0247] In 1105, after the first object selects the first multimedia resource, in response to the trigger operation of the first object on the editing control, the electronic device displays an editing page; among them, this editing page includes the first multimedia resource displayed based on the first template and a material position; this material position is used to display the materials included in the first multimedia resource.

[0248] This step can refer to the aforementioned step 605 and will not be elaborated here.

[0249] In 1106, in response to the editing operation of the first object on the materials included in the first multimedia resource, the electronic device displays the edited first multimedia resource on this editing page.

[0250] This step may refer to the aforementioned step 606 and will not be elaborated here.

[0251] In 1107, in response to a publishing operation on the editing page, the electronic device publishes the edited first multimedia resource.

[0252] In summary, the live data processing solution provided by the embodiments of the present disclosure realizes automatically generating a live highlights for users. Compared with the method of manually creating live highlights, this automatic generation method is more efficient, greatly reducing the time and labor costs, and can meet the needs of the booming live broadcast industry nowadays. In addition, this solution also applies different templates to display the live highlights of this live broadcast, and the video effect is good. In addition, after the user selects a certain template, this solution also supports the user to edit the live highlights under this template. For example, visual materials in the live highlights are presented to the user on the editing page to facilitate the user to edit the displayed visual materials. This processing method realizes the custom editing of the generated live highlights by the user, which is not only easy to operate, but also makes the finally output live highlights more in line with the user's expectations, ensuring the quality of the finally output live highlights.

[0253] Figure 12 It is a block diagram of a live data processing device shown according to an exemplary embodiment. Refer to Figure 10 , the device includes:

[0254] A first display module 1201, configured to display a first multimedia resource and an editing control of this live broadcast;

[0255] A second display module 1202, configured to display an editing page in response to a triggering operation of a first object on the editing control; wherein, the editing page includes a first multimedia resource and a material position displayed based on a first template; the material position is used to display materials included in the first multimedia resource;

[0256] A third display module 1203, configured to display the edited first multimedia resource on the editing page in response to an editing operation of the first object on the material.

[0257] The processing solution for live broadcast data provided by the embodiments of the present disclosure realizes automatically generating a live broadcast highlights for users. Compared with the way of manually making live broadcast highlights, this automatic generation method is more efficient, greatly reducing the time and labor costs, and can meet the needs of the booming live broadcast industry nowadays. During the process of displaying the multimedia resources of the current live broadcast based on a certain template, this solution also supports users to edit the multimedia resources under this template. For example, the materials included in the multimedia resources are presented to the users on the editing page, so as to facilitate the users to edit the displayed materials. This processing method realizes the custom editing of the generated live broadcast highlights by users. It is not only easy to operate, but also makes the finally output live broadcast highlights more in line with the users' expectations, ensuring the quality of the finally output live broadcast highlights.

[0258] In some embodiments, the third display module is configured to, when the first object is the host object, in response to the common editing operation of the first object and the second object on the material, display the edited first multimedia resource on the editing page;

[0259] Wherein, the second object is an object that conducts a joint live broadcast with the first object, or the second object is an object that conducts a connection interaction with the first object.

[0260] In other embodiments, the device further includes:

[0261] A fourth display module, configured to display a prompt message in response to a trigger operation on the editing control; wherein, the prompt message is used to prompt whether to perform collaborative editing;

[0262] A sending module, configured to send a collaborative editing request to the second object after selecting to perform collaborative editing with the second object in response to a collaborative editing confirmation operation.

[0263] In other embodiments, the second display module is further configured to display a collaborative editing control on the editing page;

[0264] The sending module is further configured to send a collaborative editing request to the second object after selecting to perform collaborative editing with the second object in response to a trigger operation on the collaborative editing control.

[0265] In other embodiments, the device further includes:

[0266] A fifth display module, configured to display an editing record during the collaborative editing process based on the editing operation of the second object on the first multimedia resource;

[0267] Wherein, the editing record is used to record the editing operation of the second object on the first multimedia resource.

[0268] In some other embodiments, the device further comprises:

[0269] A sixth display module, configured to display a setting panel in response to the collaborative editing confirmation operation or a triggering operation on the collaborative editing control, where the setting panel includes an object setting item, a permission setting item, and a sending method setting item;

[0270] A setting module, configured to obtain the second object for collaborative editing based on the object setting item;

[0271] The setting module is further configured to obtain the operation permission of the second object for the first multimedia resource based on the permission setting item;

[0272] The setting module is further configured to obtain the sending method of the collaborative editing request based on the sending method setting item.

[0273] In some other embodiments, the device further comprises:

[0274] A publishing module, configured to publish the edited first multimedia resource in response to a publishing operation on the editing page;

[0275] Wherein, a collaborative editing element is added to the published first multimedia resource, and the collaborative editing element is used to indicate that the first object and the second object complete the editing collaboratively.

[0276] In some other embodiments, the publishing module is further configured to publish the edited first multimedia resource in response to a publishing operation on the editing page;

[0277] Wherein, an interaction element is added to the published first multimedia resource, and the interaction element is used to display the live broadcast picture of this live broadcast after being triggered.

[0278] In some other embodiments, the second display module is further configured to display the material positions on the editing page in the playing time sequence of the materials;

[0279] Wherein, the editing operation includes any one of the following:

[0280] A deletion operation on any displayed video segment;

[0281] A replacement operation on any displayed video segment;

[0282] A deletion operation on any displayed image material;

[0283] A replacement operation on any displayed image material.

[0284] In some other embodiments, the third display module is further configured to, in response to the editing operation being a replacement operation on the material, display a first candidate material;

[0285] wherein the first candidate material is from the current live broadcast;

[0286] The arrangement mode of the first candidate materials includes any one of the following:

[0287] The first candidate materials are arranged according to the interaction heat, and the interaction heat is used to reflect the interaction effect in the live broadcast;

[0288] The first candidate materials are arranged according to the dissemination volume.

[0289] In some other embodiments, the third display module is further configured to, in response to the editing operation being a replacement operation on the material, display the playback timeline of the current live broadcast playback; in response to a material selection operation based on the playback timeline, display the selected live broadcast playback content; or,

[0290] In response to the editing operation being a replacement operation on the material, display a second candidate material; wherein the second candidate material is generated based on the recording operation during the live broadcast.

[0291] In some other embodiments, the second display module is further configured to display some editing options on the editing page; wherein the some editing options are filtered out from all editing options based on the option usage.

[0292] In some other embodiments, the second display module is further configured to display a switching option on the editing page; in response to a triggering operation on the switching option, display all the editing options on the editing page.

[0293] In some other embodiments, the some editing options include a template option;

[0294] The third display module is configured to, in response to a triggering operation on the template option, display at least one template; in response to a selection operation on a second template among the at least one template, display the first multimedia resource based on the second template.

[0295] In some other embodiments, the apparatus further includes:

[0296] A playback module, configured to, after the first multimedia resource is selected, in response to a playback operation, play the first multimedia resource based on the first template.

[0297] In some other embodiments, the second display module is configured to display the first multimedia resource, the editing control, and the publishing control;

[0298] The apparatus further includes:

[0299] A seventh display module, configured to display a publishing page in response to a triggering operation on the publishing control after the first multimedia resource is selected;

[0300] The publishing module is further configured to publish the first multimedia resource displayed based on the first template in response to a publishing operation on the publishing page.

[0301] In some other embodiments, when the first object is a host object, the current live broadcast progress reaching a preset progress includes: the current live broadcast has ended.

[0302] In some other embodiments, when the first object is an audience object, the current live broadcast progress reaching a preset progress includes:

[0303] The first object completes the live broadcast interaction, or the current live broadcast has ended;

[0304] Wherein, the first multimedia resource includes a live broadcast image when the first object conducts a live broadcast interaction.

[0305] In some other embodiments, the first display module is configured to:

[0306] Display the first multimedia resource and the editing control in response to the current live broadcast progress reaching a preset progress; or,

[0307] During the live broadcast, display the first multimedia resource and the editing control in response to a target operation; or,

[0308] After the live broadcast ends, display the first multimedia resource and the editing control in response to the target operation.

[0309] All of the above optional technical solutions can be combined arbitrarily to form alternative embodiments of the present disclosure, which will not be elaborated here.

[0310] It should be noted that when the live broadcast data processing apparatus provided in the above embodiments processes live broadcast data, only the above division of each functional unit is used for illustration. In actual applications, the above functions can be allocated to different functional units according to needs, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the live broadcast data processing apparatus provided in the above embodiments and the embodiments of the live broadcast data processing method belong to the same concept, and the specific implementation process can be seen in the method embodiments, which will not be elaborated here.

[0311] Regarding the device in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be elaborated here.

[0312] In some embodiments, an electronic device is also provided, which includes:

[0313] One or more processors;

[0314] A memory for storing program code executable by the processor;

[0315] Wherein, the processor is configured to execute the program code to implement the above method for processing live data.

[0316] Wherein, in response to the electronic device being provided as a terminal, Figure 13 is a block diagram of a terminal 1300 shown according to an exemplary embodiment.

[0317] Generally, the terminal 1300 includes a processor 1301 and a memory 1302.

[0318] The processor 1301 includes one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1301 is implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Alternatively, the processor 1301 includes a main processor and a coprocessor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state.

[0319] In some embodiments, the processor 1301 integrates a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1301 further includes an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.

[0320] The memory 1302 includes one or more computer-readable storage media, and the computer-readable storage media are non-transitory. The memory 1302 also includes high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1302 are used to store at least one program code, and the at least one program code is used to be executed by the processor 1301 to implement the method for processing live data provided in the method embodiments of the present disclosure.

[0321] In some embodiments, the terminal 1300 further includes: a peripheral device interface 1303 and at least one peripheral device. The processor 1301, the memory 1302, and the peripheral device interface 1303 are connected by a bus or signal lines. Each peripheral device is connected to the peripheral device interface 1303 through a bus, signal lines, or a circuit board. The peripheral devices include at least one of a radio frequency circuit 1304, a display screen 1305, a camera assembly 1306, an audio circuit 1307, and a power supply 1308.

[0322] The peripheral device interface 1303 is used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1301 and the memory 1302. In some embodiments, the processor 1301, the memory 1302, and the peripheral device interface 1303 are integrated on the same chip or circuit board; in other embodiments, any one or two of the processor 1301, the memory 1302, and the peripheral device interface 1303 are implemented on separate chips or circuit boards, and the present disclosure does not limit this.

[0323] The radio frequency circuit 1304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1304 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1304 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. In some embodiments, the radio frequency circuit 1304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so on. The radio frequency circuit 1304 communicates with other terminals through at least one wireless communication protocol. The wireless communication protocols include but are not limited to: the World Wide Web, a metropolitan area network, an intranet, generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1304 further includes a circuit related to NFC (Near Field Communication), and the present disclosure does not limit this.

[0324] The display screen 1305 is used to display the UI (User Interface). The UI includes graphics, text, icons, videos, and any combination thereof. When the display screen 1305 is a touch display screen, the display screen 1305 also has the ability to collect touch signals on or above the surface of the display screen 1305. The touch signal is input to the processor 1301 as a control signal for processing. At this time, the display screen 1305 is also used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there is one display screen 1305, which is provided on the front panel of the terminal 1300; in other embodiments, there are at least two display screens 1305, which are respectively provided on different surfaces of the terminal 1300 or are in a foldable design; in other embodiments, the display screen 1305 is a flexible display screen, which is provided on the curved surface or the folding surface of the terminal 1300. Alternatively, the display screen 1305 is set to an irregular non-rectangular shape, that is, a special-shaped screen. The display screen 1305 is prepared using materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0325] The camera module 1306 is used to collect images or videos. In some embodiments, the camera module 1306 includes a front camera and a rear camera. Generally, the front camera is provided on the front panel of the terminal, and the rear camera is provided on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, to implement functions such as background blurring by fusing the main camera and the depth-of-field camera, panoramic shooting by fusing the main camera and the wide-angle camera, and VR (Virtual Reality) shooting functions or other fusion shooting functions. In other embodiments, the camera module 1306 further includes a flash. The flash is a single-color temperature flash or a dual-color temperature flash. The dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which is used for light compensation under different color temperatures.

[0326] The audio circuit 1307 includes a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals for input to the processor 1301 for processing, or input to the radio frequency circuit 1304 to enable voice communication. For the purpose of stereo collection or noise reduction, there are multiple microphones, which are respectively arranged at different parts of the terminal 1300. Alternatively, the microphone is an array microphone or an omnidirectional collection type microphone. The speaker is used to convert the electrical signals from the processor 1301 or the radio frequency circuit 1304 into sound waves. The speaker is a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for uses such as ranging. In some embodiments, the audio circuit 1307 further includes a headphone jack.

[0327] The power supply 1308 is used to supply power to each component in the terminal 1300. The power supply 1308 is alternating current, direct current, a disposable battery or a rechargeable battery. When the power supply 1308 includes a rechargeable battery, the rechargeable battery is a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery is also used to support fast charging technology.

[0328] Those skilled in the art can understand that Figure 13 the structure shown in does not constitute a limitation on the terminal 1300, and it may include more or fewer components than shown in the figure, or combine certain components, or adopt different component arrangements.

[0329] In some embodiments, a computer-readable storage medium including instructions is also provided, such as a memory including instructions. The above instructions are executed by the processor of the electronic device to implement the above-mentioned live data processing method. In other embodiments, the computer-readable storage medium is ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk and optical data storage devices, etc.

[0330] In some embodiments, a computer program product is also provided, including a computer program, which when executed by the processor of the electronic device, implements the above-mentioned live data processing method.

[0331] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present disclosure. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure, which follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0332] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for processing live broadcast data, characterized in that: The method comprises: Display the primary multimedia resources and editing controls of this live broadcast; In response to the triggering operation of the first object on the editing control, an editing page is displayed; wherein the editing page includes the first multimedia resource and a material position displayed based on the first template; the material position is used to display the material included in the first multimedia resource; In response to the editing operation of the first object on the material, the edited first multimedia resource is displayed on the editing page.

2. The method for processing live broadcast data according to claim 1, characterized in that: In response to the editing operation of the first object on the material, displaying the edited first multimedia resource on the editing page includes: In the case where the first object is a host object, in response to a joint editing operation of the first object and the second object on the material, displaying the edited first multimedia resource on the editing page; The second object is an object that conducts a joint live broadcast with the first object, or the second object is an object that conducts an online interaction with the first object.

3. The method for processing live broadcast data according to claim 2, characterized in that: The method further comprises: In response to a triggering operation on the editing control, a prompt message is displayed; wherein the prompt message is used to prompt whether to perform collaborative editing; In response to the collaborative editing confirmation operation, after collaborative editing with the second object is selected, a collaborative editing request is sent to the second object.

4. The method for processing live broadcast data according to claim 2, characterized in that: The method further comprises: displaying collaborative editing controls on the editing page; In response to a triggering operation on the collaborative editing control, after collaborative editing with the second object is selected, a collaborative editing request is sent to the second object.

5. The method for processing live broadcast data according to claim 3 or 4, characterized in that: The method further comprises: During the collaborative editing process, based on the editing operation of the second object on the first multimedia resource, displaying the editing record; The editing record is used to record the editing operation of the second object on the first multimedia resource.

6. The method for processing live broadcast data according to claim 3 or 4, characterized in that: In response to the collaborative editing confirmation operation or the triggering operation on the collaborative editing control, the method further includes: Displaying a setting panel, the setting panel including object setting items, permission setting items and sending method setting items; Based on the object setting item, acquiring the second object to be collaboratively edited; Based on the permission setting item, obtaining the operation permission of the second object on the first multimedia resource; Based on the sending mode setting item, a sending mode of the collaborative editing request is acquired.

7. The method for processing live broadcast data according to claim 2, characterized in that: The method further comprises: In response to a publishing operation on the editing page, publishing the edited first multimedia resource; A collaborative editing element is added to the published first multimedia resource, and the collaborative editing element is used to indicate that the first object and the second object collaboratively complete editing.

8. The method for processing live broadcast data according to claim 1, characterized in that: The method further comprises: Displaying the material positions on the editing page in the order of the playing time of the material; The editing operation includes any of the following: Deletion of any video clip displayed; Replace any video clip being displayed; Deletion of any displayed image material; Replace any image material being displayed.

9. The method for processing live broadcast data according to claim 8, characterized in that: The method further comprises: In response to the editing operation being a replacement operation of the material, displaying a first candidate material; Wherein, the first candidate material comes from this live broadcast; The arrangement of the first candidate materials includes any one of the following: The first candidate materials are arranged according to the interaction heat, where the interaction heat is used to reflect the interaction effect in the live broadcast; The first candidate materials are arranged according to the amount of propagation.

10. The method for processing live broadcast data according to claim 8, characterized in that: The method further comprises: In response to the editing operation being a replacement operation of the material, displaying the playback timeline of the live broadcast playback; in response to the material selection operation based on the playback timeline, displaying the selected live broadcast playback content; or, In response to the editing operation being a replacement operation of the material, a second candidate material is displayed; wherein the second candidate material is generated based on a recording operation during a live broadcast.

11. The method for processing live broadcast data according to claim 1, characterized in that: The method further comprises: In response to a publishing operation on the editing page, publishing the edited first multimedia resource; Among them, an interactive element is added to the first multimedia resource after being released, and the interactive element is used to display the live broadcast screen of the live broadcast after being triggered.

12. The method for processing live broadcast data according to claim 1, characterized in that: The first multimedia resource and editing control for displaying the live broadcast include: In response to the current live broadcast progress reaching a preset progress, displaying the first multimedia resource and the editing control; or, During the live broadcast, in response to a target operation, displaying the first multimedia resource and the editing control; or, After the live broadcast ends, in response to the target operation, the first multimedia resource and the editing control are displayed.

13. A live broadcast data processing device, characterized in that: The device comprises: A first display module is configured to display a first multimedia resource and an editing control of the live broadcast; A second display module is configured to display an editing page in response to a triggering operation of the editing control by the first object; wherein the editing page includes the first multimedia resource and a material position displayed based on the first template; the material position is used to display the material included in the first multimedia resource; The third display module is configured to display the edited first multimedia resource on the editing page in response to the editing operation of the first object on the material.

14. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; The processor is configured to execute the program code to implement the method for processing live broadcast data as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for processing live broadcast data as described in any one of claims 1 to 12.

16. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor of an electronic device, implements the method for processing live broadcast data as described in any one of claims 1 to 12.

Images