VIDEO GENERATION METHOD, APPARATUS, STORAGE MEDIUM AND PROGRAM PRODUCT

Abstract

The present invention relates to a video generation method, device, equipment, storage medium, and program product, and the video generation method includes the steps of acquiring performance information of a live room and interaction information of the live room, acquiring a target video template, and generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

Description

[Technical field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This disclosure is based on and claims priority from Chinese application number 202210259142.4, filed on March 14, 2022, the disclosure of which is hereby incorporated by reference in its entirety into this disclosure.

[0002] [Technical field] The present disclosure relates to the technical field of video processing, and in particular to a video generating method, apparatus, device, storage medium and program product. [Background technology]

[0003] With the rapid development of Internet technology and terminal devices, various terminal devices (such as mobile phones and tablet computers) have become an indispensable part of people's work and life. And with the popularity of terminal devices, online live technology has emerged.

[0004] Currently, online live performances are often carried out in the form of a live room (or called a chat room), and in order to allow users to watch the live content, the live content is generally recorded and a video work is generated. However, the existing live content recording method and video generation method are single-sided, which cannot meet the diverse needs of users and affects the user experience. Summary of the Invention [Means for solving the problem]

[0005] Embodiments of the present disclosure provide a video generation method, apparatus, device, storage medium, and program product.

[0006] According to a first aspect, an embodiment of the present disclosure provides a video generation method, the video generation method comprising: acquiring performance information of the live room and interaction information of the live room; obtaining a target video template; and generating a target video using the target video template based on performance information of the live room and interaction information of the live room.

[0007] According to a second aspect, an embodiment of the present disclosure provides a video generation device, the video generation device comprising: an information acquisition module for acquiring performance information of the live room and interaction information of the live room; a template acquisition module for acquiring a target video template; and a video generating module for generating a target video using the target video template based on performance information of the live room and interaction information of the live room.

[0008] According to a third aspect, an embodiment of the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, they cause the one or more processors to implement the video generation method described in any one of the first aspects described above.

[0009] According to a fourth aspect, an embodiment of the present disclosure provides a computer readable storage medium storing a computer program which, when executed by a processor, realises the video generation method according to any one of the first aspects as described above.

[0010] According to a fifth aspect, an embodiment of the present disclosure provides a computer program product, the computer program product including computer programs or instructions which, when executed by a processor, implement the video generation method according to any one of the first aspects as described above. [Brief description of the drawings]

[0011] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0012] [Figure 1] 1 is a flowchart of a video generation method according to an embodiment of the present disclosure. [Diagram 2] 13 is a flowchart of another video generation method according to an embodiment of the present disclosure. [Diagram 3] FIG. 2 is a schematic diagram of a video generation interface in an embodiment of the present disclosure. [Figure 4] FIG. 2 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Diagram 5] FIG. 2 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 6] FIG. 2 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 7] FIG. 2 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 8] FIG. 2 is a structural schematic diagram of a video generating device in an embodiment of the present disclosure. [Figure 9] FIG. 2 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the drawings. Although the drawings show some embodiments of the present disclosure, it should be understood that the present disclosure may be realized in many forms and should not be construed as being limited to the embodiments described herein, but rather provide these embodiments for a more transparent and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only used for illustrative purposes and are not intended to limit the protection scope of the present disclosure.

[0014] It should be understood that each of the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel, and that method embodiments may include additional steps and / or omit the performance of steps that are shown, and the scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "including" and variations thereof are open inclusions, including but not limited to. The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below.

[0016] It should be noted that the concepts of "first", "second", etc. referred to in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of functions performed by these devices, modules or units.

[0017] It should be noted that the modifications "a" and "a plurality" referred to in this disclosure are general rather than limiting, and should be understood as "one or more" unless the context clearly indicates otherwise, as would be understood by one of ordinary skill in the art.

[0018] The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are used for illustration purposes only and are not used to limit the scope of these messages or information.

[0019] Currently, online live performances are often carried out in the form of live rooms (or chat rooms), and in order to allow users to repeatedly watch the live content, the live content is generally recorded and a video production is generated.

[0020] Currently, there are two main solutions for recording live content and creating video works. The first solution: simply record the live screen of the live room, and include the steps of recording comments, barrages, and gift video effects, and removing the comments, barrages, and gift video effects before recording. The second solution: record only the audio information of the live room throughout the entire process, and is called an audio work.

[0021] The first solution mentioned above only records the live scene in a live room, and the recorded video cannot be edited. The second solution mentioned above only records a pure audio work, and therefore cannot match an appropriate live scenario screen for the pure audio work to be generated, resulting in the generated audio work lacking atmosphere and unable to attract viewers to watch and listen to it.

[0022] In order to solve the above problems, the embodiment of the present disclosure provides a video generating method, which generates a target video using the target video template based on the performance information of the live room and the interaction information of the live room, and generates a video work by matching an appropriate scenario screen for a pure audio live content, thereby enhancing the atmosphere of the audio work, meeting the diversified needs of users, and improving the user experience. The following will introduce the video generating method according to the embodiment of the present disclosure in detail with reference to the drawings.

[0023] FIG. 1 is a flowchart of a video generation method in an embodiment of the present disclosure, which can be applied to the case of recording live content in a live room to generate a video, and the method can be performed by a video generation device, which can be realized in the form of software and / or hardware, and which can be disposed in an electronic device.

[0024] For example, the electronic device may be a mobile terminal, a fixed terminal or a portable terminal, such as, for example, a mobile cell phone, a station, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop personal computer, a laptop computer, a notebook computer, a netbook computer, a tablet personal computer, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof.

[0025] Also, for example, the electronic device may be a server, where the server may be an entity server or a cloud server, and the server may be a single server or a server cluster.

[0026] As shown in FIG. 1, the video generating method according to the embodiment of the present disclosure mainly includes the following steps:

[0027] S101: Acquire performance information of the live room and interaction information of the live room.

[0028] Here, the performance information of the live room may include performance user information, performance audio information, and performance song information of the live room, and may be, for example, streamer user information, streamer performance audio information, guest performance audio information, etc. The streamer user information of the live room may include one or more of a streamer user avatar, a streamer user nickname, etc. The performance song information may include one or more of lyrics of a performance song and a song title of a performance song. The performance user information, performance audio information, and performance song information of the live room may specifically be singing user information, singing audio information, and singing song information corresponding to a recorded performance segment.

[0029] Here, the interaction information of the live room may be understood to be interaction information in the live room, for example, interaction information between the streamer and the viewer during the live, interaction information between the viewer and the viewer, etc. Furthermore, the interaction information of the live room may include one or more of the number of likes received by the single song, gift information received by the single song, interaction facial expression information of the single song, comment content information of the single song, hot value at the end of the single song, like information received corresponding to the performance segment (i.e., like information received in the process of performing the performance segment), gift information corresponding to the performance segment, and comment information corresponding to the performance segment. Here, the gift information received by the single song may include one or more of the number of gifts received by the single song, gift contents, etc. The interaction facial expression information of the single song may include one or more of the number of interaction facial expressions of the single song, the user nickname and avatar who sent the interaction facial expression, etc.

[0030] In one embodiment, before obtaining the performance segment by recording and obtaining the performance information of the live room and the interaction information of the live room accordingly, the method further includes the steps of: sending a recording request for the live room to the service side in response to a recording operation for the live room by the viewer side, and sending a recording request for the live room to the streamer side via the service side, and obtaining a recording segment as the performance segment when the streamer side allows recording. Or, obtaining a recording segment as the performance segment in response to a recording operation for the live room by the streamer side. Here, the recording operation for the live room may be a trigger operation for a recording button in the live room by the recording requester, and the specific matters are not limited in this embodiment.

[0031] Furthermore, after responding to the recording operation for the live room, the recording request side generates a live room recording request for the live room and sends the live room recording request to the streamer side via the service side. After receiving the live room recording request, the streamer side presents prompt information on the presentation interface, where the prompt information is used to prompt the streamer user whether the viewer user requests to record a video and agrees to the video recording by the recording request side corresponding to the viewer user. In response to the recording request being allowed, it is indicated that the streamer user agrees to the video recording by the viewer user, at this time the streamer side sends recording agreement information to the recording request side via the service side, and the recording request side obtains the recording segment as the performance segment after receiving the recording agreement information.

[0032] Furthermore, in response to the recording request not being permitted, it is indicated that the streamer user does not agree to the viewer user recording the video, and at this time, the streamer side transmits information of non-agreement to recording to the recording requester via the service side, and the non-agreement to recording information is used to prompt the recording requester user that the streamer user does not agree to the video recording.

[0033] In this embodiment, when the streamer allows the recording request, the viewer user can record the live content that interests him / her, enhancing the interaction effect between users, and the viewer user can also create his / her own favorite videos.

[0034] In one embodiment, before obtaining the live room performance information and the live room interaction information, the method further includes obtaining a recording segment as the performance segment in response to a record operation for the live room.

[0035] In this embodiment, before the start of a live performance, when the video recording button is in an on state, the start of the live performance can be detected, that is, the recording segment of the live performance room (such as a segment between the start of the live performance and the temporary stop of the recording) is obtained as a performance segment. When detecting a trigger operation on the video recording on button in the live performance process, when the trigger operation on the video recording on button is detected, the recording segment of the live performance room (such as a segment between the start of the recording and the temporary stop of the recording) is obtained as a performance segment.

[0036] In one embodiment, the step of acquiring performance information of the live room and interaction information of the live room includes the steps of acquiring a target performance segment corresponding to the live room, and using the performance information corresponding to the target performance segment as the performance information of the live room and the interaction information corresponding to the target performance segment as the interaction information of the live room, and the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold, i.e., a good (high quality) performance segment or a highlight performance segment. That is, the recording segment may include a plurality of performance segments, and a performance segment whose performance score is greater than a preset threshold among the plurality of performance segments may be the target performance segment. Here, the performance score of the performance segment may be acquired based on a known neural network scoring model, and the specific matters are not limited.

[0037] In one embodiment, during the process of a streamer user performing, each performed sentence may be scored, and when the scores of consecutive sentences reach a preset score, the performance segment of the streamer user may be determined to be a target performance segment. A score for each performance segment may be obtained based on the scores of the sentences corresponding to each performance segment, and a performance segment whose score is greater than the preset score may be determined as the target performance segment.

[0038] When the application program has a scoring scale of C, B, A, S, SS, SSS, the preset score may be set to S or SS, etc. It should be noted that this embodiment is not limiting but is merely for illustrative purposes of the preset scores.

[0039] Here, the "multiple" in the scoring of the multiple simple sentences reaching a preset score may be set according to the actual situation. For example, it may be three simple sentences or five simple sentences, and is not specifically limited in this embodiment.

[0040] In this embodiment, after determining that the streamer user's performance segment is the target performance segment, initiate the step of obtaining performance information and interaction information corresponding to the target performance segment in the live room as live room performance information and live room interaction information, respectively, thus ensuring that the recorded performance audio is good audio, and further ensuring the quality of the video generated later.

[0041] In one embodiment, the step of obtaining a target performance segment corresponding to a live room includes the steps of obtaining a performance segment within a preset time period of the live room, dividing the performance segment into a plurality of target performance segments according to preset requirements, and performing a process of obtaining a target video template and subsequent processes for at least one target performance segment.

[0042] Here, the preset time period may be a period from the start of recording to the end of recording, where the start of recording may refer to the description in the above embodiment, and the end of recording may be the end of a live broadcast or may be a time corresponding to the detection of a trigger operation on the video recording off button.

[0043] Here, the predefined requirements may include the recorded segment with the most likes, the recorded segment with the most comments, the recorded segment with the most online users, the recorded segment with the highest score, and so on.

[0044] Dividing the recording file into a plurality of recording segments according to preset requirements may include dividing the recording file into recording segments with the most likes, recording segments with the most comments, recording segments with the most online users, recording segments with the highest scores, etc. Accordingly, different target video templates may be adopted for each target performance segment.

[0045] In one embodiment, in response to a temporary stop operation of the performance recording, at least one performance segment identifier and at least one corresponding performance information and at least one interaction information are displayed, and in response to a selection operation on the target performance information and the target interaction information corresponding to a target performance segment identifier, the target performance information and the target interaction information can be used as the performance information of the live room and the interaction information of the live room, respectively. The performance segment may be a recorded segment after the start of the performance recording and before the temporary stop of the performance recording, and may be a part of the recorded segment, such as a highlight segment of the recorded segment. The target performance segment identifier may be any performance segment identifier of the at least one performance segment identifier. The performance segment identifier may be a number, a segment name, a description, etc. corresponding to a performance segment. The target performance information is the performance information in a selected state among the at least one performance information, and the target interaction information is the interaction information in a selected state among the at least one interaction information. A user may select all or a portion of performance information corresponding to one performance segment identifier as live room performance information for generating a target video, or may select all or a portion of performance information corresponding to multiple performance segment identifiers as live room performance information for generating a target video, and a user may select all or a portion of interaction information corresponding to one performance segment identifier as live room interaction information for generating a target video, or may select all or a portion of interaction information corresponding to multiple performance segment identifiers as live room interaction information for generating a target video.Exemplarily, the at least one interaction information may be comment interaction information and like interaction information, and a user may select the comment interaction information and / or the like interaction information as interaction information in a live room to generate a target video, thereby providing rich creative control for the user, satisfying the diversified needs of the user, and enhancing the user experience.

[0046] S102: Obtain a target video template.

[0047] Here, the target video template may be understood as a template that needs to be used to generate a target video, and the target video template may be a script file, where the target video template is used to generate a target video by adding live room performance information and live room interaction information to a preset position of the video template.

[0048] In this embodiment, obtaining the target video template may be selecting any one or more video templates from a video template database.

[0049] In one embodiment, if there are multiple target performance segments, the multiple target performance segments may use the same target video template or different target video templates.

[0050] In one embodiment, the step of acquiring the target video template includes the steps of: displaying one or more candidate video templates in response to a template acquisition request; and using the selected candidate video template as the target video template in response to a selection operation on any one of the one or more candidate video templates.

[0051] Here, the step of responding to the template acquisition request may include a step of responding to the template acquisition request after detecting a trigger operation on the template acquisition button, and may further include a step of responding to the template acquisition request after detecting completion of acquisition of the performance information of the live room and the interaction information of the live room.

[0052] The candidate video template may be a template determined in response to a user request and matched with the performance information of the live room and the interaction information of the live room, for example, a video template whose matching degree between the performance information of the live room and the interaction information of the live room is greater than a preset threshold is determined as the candidate video template. Specifically, the client sends a template acquisition request to the service side, and after receiving the template acquisition request, the service side determines a corresponding candidate template based on the performance information of the live room and the interaction information of the live room, and delivers and presents the candidate template to the client. The matching degree may be determined based on a known matching degree determination method, which will not be described further herein.

[0053] In this embodiment, the candidate video templates are displayed according to the performance information of the live room and the interaction information of the live room, making it easy for the user to quickly select a suitable video template.

[0054] S103: Generate a target video using the target video template according to performance information of the live room and interaction information of the live room.

[0055] In one embodiment, the live room performance information and the live room interaction information may be filled in the corresponding positions of the video template to generate a target video.

[0056] Here, at least one reserved position is set in the video template, and the at least one reserved position is used to fill the performance information and / or the interaction information of the live room to generate the target video, and may also be used to fill the link address of the performance information and / or the interaction information of the live room to generate the target video. At the same time, label information is set for each reserved position, and information matching the label information is filled in the corresponding reserved position. The label information may be the above-mentioned performance information or interaction information type, such as the avatar of the streamer user, the nickname of the streamer user, the performance lyrics corresponding to the target performance segment, the song name corresponding to the target performance segment, the single song interaction facial expression information, the number of single song comments, etc.

[0057] In this embodiment, after the live performance ends, the performance information of the live room and the interaction information of the live room may be filled in the corresponding positions of the video template to generate a target video, and after the single song ends, the performance information of the live room and the interaction information of the live room may be filled in the corresponding positions of the video template to generate a target video.

[0058] In one embodiment, the step of generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room includes the steps of generating target audio information and target screen information using the target video template based on audio information corresponding to the performance segment, music information corresponding to the performance segment, and interaction information corresponding to the performance segment, and generating the target video based on the target audio information and target screen information.

[0059] An embodiment of the present disclosure provides a video generating method, which includes: acquiring performance information of a live room and interaction information of the live room; acquiring a target video template; and generating a target video using the target video template according to the performance information of the live room and the interaction information of the live room. The present disclosure matches a suitable scenario screen for a pure audio live content to generate a video work, and enhances the atmosphere of the audio work.

[0060] Based on the above embodiment, the embodiment of the present disclosure further optimizes the above video generating method, and as shown in FIG. 2, the optimized video generating method of the embodiment of the present disclosure mainly includes the following steps:

[0061] S201: Acquire performance information and interaction information of the live room.

[0062] S202: Obtain a target video template.

[0063] S203: Generate a target video by using the target video template according to performance information of the live room and interaction information of the live room.

[0064] The implementation process and specific principles of S201-S203 are the same as S101-S103 in the above embodiment, and specific details can be found in the description of the above embodiment, and will not be further described here.

[0065] S204: Displaying video identifiers corresponding to the multiple performance videos.

[0066] Here, the target video includes a plurality of performance videos.

[0067] Here, the video identifier may include characteristic information of the performance video, such as the performance video with the most likes, the performance video with the most comments, the performance video with the most online users, the performance video with the highest score, etc.

[0068] As shown in FIG. 3, the avatar of the streamer user is displayed in the video generation interface 300, the name of the streamer user is displayed below the streamer user, and video identifiers corresponding to a number of performance videos that have already been generated, such as the performance video 301 with the most gifts received as shown in FIG. 3, the performance video with the most interactions, and a performance video corresponding to the chorus part, are displayed in the video generation interface 300.

[0069] Furthermore, in response to a user's slide operation on the performance video, a different performance video may be displayed in an intermediate position on the video generation interface 300. For example, in Fig. 3, in response to a user's slide operation to the left on the performance video, a performance video corresponding to a hook part may be displayed in an intermediate position on the video generation interface 300, and in response to a user's slide operation to the right on the performance video, a performance video corresponding to an interaction part may be displayed in an intermediate position on the video generation interface 300.

[0070] It should be noted that the performance video displayed in the middle position of the video generation interface 300 is determined as the selected performance video, and subsequent operations can be performed on the selected performance video.

[0071] S205: In response to a save operation on a target performance video corresponding to a target video identifier, save the target performance video, where the target video identifier is any one or more video identifiers among video identifiers corresponding to a plurality of performance videos.

[0072] Here, the target video identifier means a video identifier selected by a user and corresponding to a video that the user wants to perform subsequent editing, where the save button may be a virtual button (such as a "Save Draft" button in the video generation interface 300 shown in FIG. 3) or an entity button (such as a volume up button in a smart terminal).

[0073] For example, in response to a touch operation on a "save draft" button in the video generation interface 300, the target performance video displayed at the middle position of the video generation interface 300 is saved in a draft box. Furthermore, the target performance video in the draft box can be edited.

[0074] S206: In response to a posting operation on a target performance video corresponding to a target video identifier, post the target performance video.

[0075] Here, the post button may be a virtual button (such as a "Post Now" button in the video generation interface 300 shown in FIG. 3), and the trigger operation may be any one of a click, a double click, and a touch.

[0076] For example, in response to a touch operation on a “post now” button in the video generation interface 300, the target performance video displayed in the middle position of the video generation interface 300 is saved and posted.

[0077] It should be noted that this embodiment does not limit the order of execution of steps S205 and S206, and S205 may be executed first, or S206 may be executed first, or S205 may be executed second, or only one of the steps may be executed.

[0078] In one embodiment, the video generating method according to an embodiment of the present disclosure further includes adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0079] Here, the live room link is a kind of hyperlink in web page creation, which can quickly anchor to the live room. For example, the live room link in this embodiment can be added to the image or name of the streamer user in the video generation interface 300, or can be added to the background image of the target video. It should be noted that this embodiment only exemplifies the adding position of the live room link, and is not limited thereto.

[0080] The method further includes the step of displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0081] After the video is posted, in response to an operation on the live room link by the viewing user, a live interface corresponding to the live room is displayed on the terminal interface of the viewing user.

[0082] Furthermore, in response to an operation on the live room link by a viewer user, an inquiry is made as to whether or not the live room is live, and if so, a live interface corresponding to the live room is displayed on the terminal interface of the viewer user.If the live room is not live, a live room similar to the live room is obtained and displayed on the terminal interface of the viewer user.

[0083] In this embodiment, by adding a live room link to the target video, it is possible for returning users to quickly enter the live room, simplify the flow for users to enter the live room, and improve the user experience.

[0084] Based on the above embodiment, the step of generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room includes the steps of displaying a video editing interface in response to a video editing operation, obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface, and generating a target video using the target video template based on the display parameters of the performance information and / or the interaction information.

[0085] Here, the display parameters of the performance information and / or the interaction information may include background parameters (such as background pattern, background brightness, etc.), lyric display parameters (such as font size, color, etc.), comment display parameters (such as display position, display time length, etc.), clips of recorded segments, additional sticker display parameters, etc.

[0086] Furthermore, the target video may be edited before the target video is generated, or the target video may be edited after the target video is generated.

[0087] In this embodiment, by editing the target video, the user can edit the target video generated by a pure audio file, so as to enhance the editability of the video and improve the user's usage experience.

[0088] As shown in FIG. 4 , a video editing interface 400 is opened in an embodiment of the present disclosure, in which a song name corresponding to a currently performed segment is displayed at the top of the video editing interface 400, a streamer user's avatar is displayed in the middle, and a hotness value at the end of the single song is displayed below the streamer user's avatar; lyrics corresponding to a target video are displayed on the video editing interface 400, and comment information 401 corresponding to the target video is displayed above the streamer user's avatar, and the comment information includes the user avatar sending the comment and the comment content.

[0089] Furthermore, in response to a trigger operation on the "daily post" button 402, the target video is posted. In response to a trigger operation on the "next" button 403, the video editing interface 400 displays the next content to be edited.

[0090] In this embodiment, the background of the video, the display style of lyrics, the display style of comments, the style of characters, the style of additional stickers and stickers, cuts of audio corresponding to the video, etc. may be edited.

[0091] In one embodiment, the step of obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface includes the step of displaying all comment formats corresponding to comments in the video editing interface in response to a trigger operation on a comment format button of the video editing interface, and the step of replacing the current comment format with the selected comment format in response to a selection operation on a comment format.

[0092] Here, the selection operation for the comment style may be a touch operation for the comment style. Furthermore, as shown in Fig. 5, all of the comment styles are displayed in a comment style selection box corresponding to the video editing interface 400, and the current comment style is replaced by the selected comment style in response to the selection operation for the comment style by the user.

[0093] Furthermore, as shown in Fig. 5, in this embodiment, the comments may be curated and a preset number of comments may be selected and displayed, for example, 10 comments may be selected and displayed from among the comments. Here, the preset number of comments may be some of the top comments in terms of the number of likes received, or may be a preset number of comments manually selected by a live user.

[0094] In one embodiment, the step of obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface includes the steps of: displaying all lyric styles corresponding to lyrics on the video editing interface in response to a trigger operation on a lyric style button on the video editing interface; and replacing the current lyric style with the selected lyric style in response to a selection operation on a lyric style.

[0095] Here, the selection operation for the lyrics style may be a touch operation for the lyrics style. Furthermore, as shown in Fig. 6, all lyrics styles are displayed in a lyrics style selection box corresponding to the video editing interface 400, and the current lyrics style is replaced by the selected lyrics style in response to the selection operation for the lyrics style by the user.

[0096] In one embodiment, the edited target video is posted, and the target video display interface after posting displays a cover picture or an avatar of the original singer corresponding to the song in the target video in the middle position of the target video display interface 600, displays a hot value corresponding to the end of the single song below the middle position, and displays lyrics corresponding to the audio segment below the hot value in sequence. Below the lyrics, a text description entered by the user when posting the video may be displayed. A live room link is displayed in the upper left corner of the target video display interface 600, and in response to a trigger operation on the link, a live room corresponding to the streamer user is jumped to. Related buttons that can be operated by the viewing user, such as a follow button, a comment button, a gift sending button, and a forward button, corresponding to the target video, are displayed in sequence in the lower right of the target video display interface 600.

[0097] The embodiment of the present disclosure matches appropriate live scenario screens for pure audio works, enhances the atmosphere of the audio works, and can also edit the target video, set comment style, add text descriptions, replace background pictures, add stickers, etc., to enhance the hobby of the target video.

[0098] FIG. 8 is a structural schematic diagram of a video generating device in an embodiment of the present disclosure, which can be applied to the case of recording pure live audio in a live room to generate video, and the video generating device can be realized in the manner of software and / or hardware, and the video generating device can be disposed in an electronic device.

[0099] As shown in FIG. 8 , a video generating device 80 according to an embodiment of the present disclosure mainly includes an information acquiring module 81, a template acquiring module 82, and a video generating module 83.

[0100] Here, the information acquisition module 81 is used to acquire performance information of the live room and interaction information of the live room, the template acquisition module 82 is used to acquire a target video template, and the video generation module 83 is used to generate a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0101] An embodiment of the present disclosure provides a video generating device for executing a flow of acquiring performance information of a live room and interaction information of the live room, acquiring a target video template, and generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room. In an embodiment of the present disclosure, a video work is generated by matching an appropriate scenario screen for a pure audio live content, and the atmosphere of the audio work is enhanced.

[0102] In one embodiment, the information acquisition module 81 includes: a performance segment acquisition unit for acquiring a target performance segment corresponding to a live room; and an information determination unit for using performance information corresponding to the target performance segment as performance information of the live room, and using interaction information corresponding to the target performance segment as interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0103] In one embodiment, the video generating device further includes a recording request sending module for sending a recording request for the live room to the service side in response to a recording operation for the live room, and for sending the recording request for the live room to the streamer side via the service side, and a recording segment acquisition module for acquiring a recording segment as a performance segment when the streamer side allows recording.

[0104] In one embodiment, the template acquisition module 82 includes a candidate template display unit for displaying one or more candidate video templates in response to a template acquisition request, and a target template determination unit for using a selected candidate video template as a target video template in response to a selection operation on any one of the one or more candidate video templates.

[0105] In one embodiment, the target video includes a plurality of performance videos, and the video generation device further includes a video identifier display module for displaying a video identifier corresponding to the plurality of performance videos, and a performance video operation module for saving the target performance video in response to a save operation on the target performance video corresponding to the target video identifier and / or posting the target performance video in response to a post operation on the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

[0106] In one embodiment, the apparatus further comprises a link adding module for adding a live room link to a target video and presenting the live room link in a playback process of the target video.

[0107] In one embodiment, the apparatus further includes a live interface display module for displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0108] In one embodiment, the video generation module 83 includes an editing interface display unit for displaying a video editing interface in response to a video editing operation, a display parameter acquisition unit for acquiring display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface, and a target video generation unit for generating a target video using the target video template based on the display parameters of the performance information and / or the interaction information.

[0109] The video generation device according to the embodiments of the present disclosure can perform the steps performed in the video generation method according to the embodiments of the method of the present disclosure, and the performing steps and beneficial effects it has will not be described further here.

[0110] The modules or units may be implemented as software assemblies running on one or more general-purpose processors, or as hardware performing, for example, some functions or a combination thereof, for example, as programmable logic devices and / or application specific integrated circuits. In some embodiments, the modules or units may be embodied in the form of a software product, which may be stored in a non-volatile storage medium, which includes a program that causes a computing device (for example, a personal computer, a server, a network device, a mobile terminal, etc.) to implement the method described in the embodiments of the present disclosure. In other embodiments, the modules or units may be implemented in a single device or distributed across multiple devices. The functions of the modules or units may be integrated together or further divided into multiple sub-units.

[0111] FIG. 9 is a structural schematic diagram of an electronic device in an embodiment of the present disclosure. Hereinafter, referring specifically to FIG. 9, a structural schematic diagram for realizing an electronic device 900 in an embodiment of the present disclosure is shown. The electronic device 900 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet personal computers), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals), wearable terminal devices, and fixed terminals such as digital TVs, desktop personal computers, and smart home devices. The electronic device shown in FIG. 9 is merely an example and does not limit the functions and scope of use of the embodiment of the present disclosure.

[0112] As shown in Fig. 9, the electronic device 900 may include a processing unit 901 (e.g., a central processor, a graphics processor, etc.) capable of performing various suitable operations and processes based on a program stored in a read-only memory (ROM) 902 or loaded from a storage device 908 into a random access memory (RAM) 903 to realize the picture rendering method of the embodiment described in the present disclosure. The RAM 903 stores various programs and data necessary for the operation of the terminal device 900. The processing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0113] Typically, input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyro, etc., output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc., storage devices 908 including, for example, a magnetic tape, a hard disk, etc., and communication devices 909 may be connected to the I / O interface 905. The communication devices 909 may enable wireless or wired communication between the terminal device 900 and other devices to exchange data. Although FIG. 9 shows the terminal device 900 having various devices, it should be understood that it is not necessary to implement or include all of the devices shown. More or fewer devices may be implemented or included.

[0114] In particular, according to an embodiment of the present disclosure, the above process can be realized as a computer software program with reference to the flowchart. For example, an embodiment of the present disclosure includes a computer program product, including a computer program stored on a non-transitory computer-readable medium, the computer program including a program code for executing the method shown in the flowchart, thereby realizing the page jump method described above. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, or may be installed from the storage device 908, or may be installed from the ROM 902. When the computer program is executed by the processing device 901, it performs the above functions defined by the method of the embodiment of the present disclosure.

[0115] It should be explained that the computer-readable medium of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of both. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of more than one. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (such as an EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that includes or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include, but is not limited to, a propagated data signal having computer-readable program code thereon, either in baseband or as part of a carrier. Such a propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained within the computer-readable medium may be transmitted by any suitable medium, including but not limited to electrical wire, optical cable, RF (radio frequency), or the like, or any suitable combination of the above.

[0116] In some embodiments, the clients and servers may communicate using any network protocol now known or later developed, such as, for example, HyperText Transfer Protocol (HTTP), and may be communicatively connected (e.g., via a communications network) with digital data in any form or medium. Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), external networks (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any networks now known or later developed.

[0117] The computer readable medium may be included in the electronic device or may exist separately and not integrated into the electronic device.

[0118] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the terminal device, they cause the terminal device to perform the following steps: acquiring live room performance information and live room interaction information; acquiring a target video template; and generating a target video using the target video template based on the live room performance information and the live room interaction information.

[0119] Optionally, when the one or more programs are executed by the terminal device, the terminal device can further execute other steps described in the above embodiments.

[0120] Computer program code for carrying out the operations of the present disclosure can be written in one or more program design languages ​​or combinations thereof, including, but not limited to, object-oriented program design languages ​​such as Java, Smalltalk, C++, and the like, and may further include general procedural program design languages ​​such as "C" or similar program design languages. The program code may be executed entirely by the user computer, partially by the user computer, as a separate software package, partially by the user computer and partially by a remote computer, or entirely by a remote computer or by a server. When referring to a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0121] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment or part of code, which includes one or more executable instructions for implementing the specified logical function. It should be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than the order marked in the drawings. For example, two blocks shown in succession may actually be executed essentially in parallel or may be executed in the reverse order depending on the functions involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified functions or operations, or may be implemented in a combination of dedicated hardware and computer instructions.

[0122] The units described in the embodiments of the present disclosure may be implemented in a software manner or a hardware manner, and the names of the units do not constitute limitations on the units themselves in some cases.

[0123] The functionality described herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific general purpose products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0124] In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program used by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, portable computer disks, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (such as EPROMs or flash memories), optical fibers, compact disk read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0125] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, which includes the steps of acquiring live room performance information and live room interaction information, acquiring a target video template, and generating a target video using the target video template based on the live room performance information and the live room interaction information.

[0126] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating method, in which the step of acquiring performance information of a live room and interaction information of the live room includes the steps of acquiring a target performance segment corresponding to a live room, and using the performance information corresponding to the target performance segment as the performance information of the live room, and using the interaction information corresponding to the target performance segment as the interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0127] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating method, which further includes the steps of: in response to a recording operation for a live room, sending a recording request for the live room to a service side, and sending the recording request for the live room to a streamer side via the service side; and, if the streamer side allows recording, obtaining a recording segment as a performance segment.

[0128] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, in which the step of acquiring a target video template includes the steps of: displaying one or more candidate video templates in response to a template acquisition request; and using a selected candidate video template as a target video template in response to a selection operation on any one of the one or more candidate video templates.

[0129] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, wherein the target video includes a plurality of performance videos, the video generation method further includes a step of displaying a video identifier corresponding to the plurality of performance videos, a step of saving the target performance video in response to a save operation on the target performance video corresponding to the target video identifier, and / or a step of posting the target performance video in response to a post operation on the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

[0130] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, which further includes a step of adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0131] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, the video generation method further including a step of displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0132] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, in which the step of generating a target video using the target video template based on performance information of the live room and interaction information of the live room includes the steps of: displaying a video editing interface in response to a video editing operation; acquiring display parameters of the performance information and / or display parameters of the interaction information in response to an input operation on the video editing interface; and generating a target video using the target video template based on the display parameters of the performance information and / or the display parameters of the interaction information.

[0133] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating device, which includes: an information acquisition module for acquiring performance information of a live room and interaction information of the live room; a template acquisition module for acquiring a target video template; and a video generation module for generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0134] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating device, wherein an information acquisition module includes: a performance segment acquisition unit for acquiring a target performance segment corresponding to a live room; and an information determination unit for using performance information corresponding to the target performance segment as performance information of the live room, and using interaction information corresponding to the target performance segment as interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0135] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating device, which further includes: a recording request sending module for sending a recording request of the live room to a service side in response to a recording operation for the live room, and sending the recording request of the live room to a streamer side via the service side; and a recording segment acquisition module for acquiring a recording segment as a performance segment when the streamer side allows recording.

[0136] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, in which a template acquisition module includes: a candidate template display unit for displaying one or more candidate video templates in response to a template acquisition request; and a target template determination unit for utilizing a selected candidate video template as a target video template in response to a selection operation on any one of the one or more candidate video templates.

[0137] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, wherein the target video includes a plurality of performance videos, the video generation device further includes a video identifier display module for displaying a video identifier corresponding to the plurality of performance videos, and a performance video operation module for saving the target performance video in response to a save operation on the target performance video corresponding to the target video identifier and / or posting the target performance video in response to a post operation on the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

[0138] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, which further includes a link adding module for adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0139] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, the video generation device further including a live interface display module for displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0140] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating device, in which a video generation module includes: an editing interface display unit for displaying a video editing interface in response to a video editing operation; a display parameter acquisition unit for acquiring display parameters of the performance information and / or display parameters of the interaction information in response to an input operation on the video editing interface; and a target video generation unit for generating a target video using the target video template based on the display parameters of the performance information and / or the display parameters of the interaction information.

[0141] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a memory for storing one or more programs; When the one or more programs are executed by the one or more processors, they cause the one or more processors to implement any one of the video generation methods described herein.

[0142] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, the computer program being capable of implementing any one of the video generation methods described herein when executed by a processor.

[0143] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions that, when executed by a processor, implements the video generation method described above.

[0144] The above description is merely a description of the preferred embodiments of the present disclosure and the technical principles used. It should be understood by those skilled in the art that the disclosure scope of the present disclosure is not limited to the technical solution of the specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure idea, such as the above features and technical features having similar functions to those disclosed in the present disclosure (but not limited to) are substituted for each other.

[0145] It should be noted that although operations are illustrated in a particular sequence, this should not be understood as requiring that these operations be performed in the particular sequence or order shown. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limitations on the scope of the disclosure. Some features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination.

[0146] Although the present subject matter has been described using language specific to structural features and / or methodological logical operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. On the contrary, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. 1. A method for generating video, comprising: acquiring performance information of the live room and interaction information of the live room; obtaining a target video template; and generating a target video using the target video template based on performance information of the live room and interaction information of the live room. Video generation methods.

2. The step of acquiring performance information of the live room and interaction information of the live room includes: obtaining a target performance segment corresponding to the live room; 2. The video generation method of claim 1, further comprising the steps of: using performance information corresponding to the target performance segment as performance information of a live room; and using interaction information corresponding to the target performance segment as interaction information of a live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

3. a step of transmitting a request to record the live room to a service side in response to a recording operation for the live room, and transmitting the request to record the live room to a streamer side via the service side; The video generating method of claim 2, further comprising: if the recording request is granted at a streamer, obtaining a recorded segment as the target performance segment.

4. The steps of obtaining a target video template include: displaying one or more candidate video templates in response to the template acquisition request; and in response to a selection operation on any one of the one or more candidate video templates, utilizing the selected candidate video template as a target video template.

5. The video generating method of claim 4, further comprising: determining one or more video templates having a matching degree with the performance information of the live room and the interaction information of the live room greater than a specified threshold as the one or more candidate video templates.

6. the target video includes a plurality of performance videos; The method of claim 1 , further comprising displaying video identifiers corresponding to the plurality of performance videos.

7. in response to a save operation on a target performance video corresponding to the target video identifier, storing the target performance video; or posting a target performance video in response to a posting operation on the target performance video corresponding to the target video identifier; wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

8. The video generating method of claim 1 , further comprising the step of: in response to a link adding operation, adding a live room link of the live room to the target video and presenting the live room link in a playback process of the target video.

9. 10. The video production method of claim 8, further comprising the step of displaying a live interface corresponding to the live room in response to a trigger operation on the live room link.

10. generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room, displaying a video editing interface in response to a video editing operation; acquiring at least one of a display parameter of the performance information and a display parameter of the interaction information in response to an input operation on the video editing interface; The video generation method of claim 1, further comprising: a step of generating the target video using the target video template based on at least one of display parameters of the performance information of the live room and display parameters of the interaction information of the live room, and based on the performance information of the live room and the interaction information of the live room.

11. The step of obtaining a display parameter of the performance information in response to an input operation on the video editing interface includes: displaying all of the lyric styles corresponding to lyrics in the video editing interface in response to a trigger operation on a lyric style button of the video editing interface; and in response to a selection operation for a lyric style, replacing a current lyric style with the selected lyric style.

12. generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room, The video generating method according to claim 1 , further comprising: filling in performance information of the live room and interaction information of the live room at designated positions of the target video template to obtain a target video.

13. 1. A video generation device, comprising: an information acquisition module for acquiring performance information of the live room and interaction information of the live room; a template acquisition module for acquiring a target video template; and a video generation module for generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room. Video generation equipment.

14. An electronic device, Memory, a processor coupled to the memory and configured to execute the video generation method of any one of claims 1 to 12 based on instructions stored in the memory, electronic equipment.

15. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implements the video generation method of any one of claims 1 to 12.

16. 1. A video generation device, comprising: A processor; a memory storing a computer program; A video production device, the computer program, when executed by the processor, causing the video production device to implement the video production method of any one of claims 1 to 12.

17. A computer program comprising: A computer program comprising instructions which, when executed by a processor, cause the processor to carry out the video generation method of any one of claims 1 to 12.

Images