Video generation method, device, equipment, storage medium and program product

Abstract

The present invention relates to a video generation method, device, equipment, storage medium, and program product, and the video generation method includes the steps of acquiring performance information of a live room and interaction information of the live room, acquiring a target video template, and generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This disclosure is based on and claims priority from Chinese application number 202210259142.4, filed on March 14, 2022, the disclosure of which is hereby incorporated by reference in its entirety.

[0002] [Technical field] The present disclosure relates to the technical field of video processing, and in particular to a video generation method, apparatus, device, storage medium and program product. [Background technology]

[0003] With the rapid development of Internet technology and terminal devices, various terminal devices (such as mobile phones and tablet computers) have become an indispensable part of people's work and life. And with the widespread use of terminal devices, online live technology has emerged.

[0004] Currently, online live events are often carried out in the form of live rooms (also called chat rooms), and in order to allow users to watch the live content, the live content is generally recorded and a video work is generated. However, the existing live content recording method and video generation method only have a single method, which results in being unable to meet the diverse needs of users and affects the user experience. Summary of the Invention [Means for solving the problem]

[0005] Embodiments of the present disclosure provide a video generation method, apparatus, device, storage medium, and program product.

[0006] According to a first aspect, an embodiment of the present disclosure provides a video generation method, the video generation method comprising: acquiring performance information of the live room and interaction information of the live room; obtaining a target video template; and generating a target video using the target video template based on performance information of the live room and interaction information of the live room.

[0007] According to a second aspect, an embodiment of the present disclosure provides a video generation device, the video generation device comprising: an information acquisition module for acquiring performance information of the live room and interaction information of the live room; a template acquisition module for acquiring a target video template; a video generation module for generating a target video using the target video template based on performance information of the live room and interaction information of the live room.

[0008] According to a third aspect, an embodiment of the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the video generation method described in any one of the first aspects above.

[0009] According to a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the video generation method according to any one of the first aspects described above.

[0010] According to a fifth aspect, an embodiment of the present disclosure provides a computer program product, the computer program product including a computer program or instructions that, when executed by a processor, implements the video generation method according to any one of the first aspects as described above. [Brief explanation of the drawings]

[0011] These and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent upon reference to the following detailed description in conjunction with the drawings. Throughout the drawings, identical or similar reference numerals represent identical or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0012] [Figure 1] 1 is a flowchart of a video generation method according to an embodiment of the present disclosure. [Figure 2] 10 is a flowchart of another video generation method according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is a schematic diagram of a video generation interface in an embodiment of the present disclosure. [Figure 4] FIG. 1 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 5] FIG. 1 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 6] FIG. 1 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 7] FIG. 1 is a schematic diagram of a video editing interface in an embodiment of the present disclosure. [Figure 8] FIG. 1 is a structural schematic diagram of a video generation device in an embodiment of the present disclosure. [Figure 9] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the drawings. Although the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure may be realized in many forms and should not be construed as being limited to the embodiments described herein, but rather these embodiments are provided for a clearer and more complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are used for illustrative purposes only and are not intended to limit the protection scope of the present disclosure.

[0014] It should be understood that each step described in the method embodiments of the present disclosure may be performed in a different order and / or in parallel, and that method embodiments may include additional steps and / or omit performing steps as shown, and the scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "comprises" and variations thereof are open inclusions, including but not limited to. The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below.

[0016] It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of functions performed by these devices, modules or units.

[0017] It should be noted that the modifications "one" and "multiple" referred to in this disclosure are general rather than limiting and should be understood as "one or more" unless the context clearly dictates otherwise, as would be understood by one skilled in the art.

[0018] The names of messages or information exchanged between devices in the embodiments of the present disclosure are used for illustrative purposes only and are not used to limit the scope of these messages or information.

[0019] Currently, online live events are often held in the form of live rooms (also called chat rooms), and in order to allow users to repeatedly watch the live content, the live content is generally recorded and a video production is generated.

[0020] Currently, there are two main solutions for recording live content and creating video works. The first solution involves simply recording the live screen of the live room, along with recording comments, barrages, and gift video effects, and recording the comments, barrages, and gift video effects. The second solution involves recording only the audio information of the live room throughout the entire process, which is called an audio work.

[0021] The first solution mentioned above only records the live footage of a live room, and the resulting video cannot be edited; the second solution mentioned above only records a pure audio work, and therefore cannot match an appropriate live scenario screen for the pure audio work to be generated, resulting in a lack of atmosphere in the generated audio work and unable to attract viewers to watch and listen to it.

[0022] To solve the above problems, an embodiment of the present disclosure provides a video generation method, which generates a target video using the target video template based on the performance information and interaction information of the live room, and generates a video work by matching an appropriate scenario screen for pure audio live content, thereby enhancing the atmosphere of the audio work, meeting the diversified needs of users, and improving the user experience. The video generation method according to the embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0023] FIG. 1 is a flowchart of a video generation method in an embodiment of the present disclosure, which can be applied to recording live content in a live room to generate a video, and the method can be performed by a video generation device, which can be realized in the form of software and / or hardware, and which can be disposed in an electronic device.

[0024] For example, the electronic device may be a mobile terminal, fixed terminal or portable terminal such as a mobile mobile phone, station, unit, device, multimedia computer, multimedia tablet, Internet node, communicator, desktop personal computer, laptop computer, notebook computer, netbook computer, tablet personal computer, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camcorder, positioning device, television receiver, radio broadcast receiver, e-book device, gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof.

[0025] Also, for example, the electronic device may be a server, where the server may be an entity server or a cloud server, and the server may be a single server or a server cluster.

[0026] As shown in FIG. 1, the video generating method according to the embodiment of the present disclosure mainly includes the following steps:

[0027] S101: Acquire performance information and interaction information of the live room.

[0028] Here, the performance information of the live room may include performance user information, performance audio information, and performance song information of the live room, such as streamer user information, streamer performance audio information, and guest performance audio information. The streamer user information of the live room may include one or more of a streamer user avatar, a streamer user nickname, etc. The performance song information may include one or more of lyrics of the performance song and the title of the performance song. The performance user information, performance audio information, and performance song information of the live room may specifically be singing user information, singing audio information, and singing song information corresponding to the recorded performance segment.

[0029] Here, the interaction information of the live room may be understood to mean interaction information within the live room, such as interaction information between the streamer and viewers during the live stream, interaction information between viewers, etc. Furthermore, the interaction information of the live room may include one or more of the number of likes received for the single song, gift information received for the single song, interaction expression information for the single song, comment content information for the single song, hotness value at the end of the single song, like information received corresponding to a performance segment (i.e., like information received during the performance of the performance segment), gift information corresponding to the performance segment, and comment information corresponding to the performance segment. Here, the gift information received for the single song may include one or more of the number of gifts received for the single song, gift content, etc. The interaction expression information for the single song may include one or more of the number of interaction expressions for the single song, the nickname and avatar of the user who sent the interaction expression, etc.

[0030] In one embodiment, before acquiring the performance segment by recording and correspondingly acquiring the performance information and interaction information of the live room, the method further includes the steps of: transmitting a recording request for the live room to the service side in response to a recording operation for the live room by the viewer side, and transmitting the recording request for the live room to the streamer side via the service side; and, if the streamer side allows recording, acquiring the recorded segment as the performance segment. Alternatively, acquiring the recorded segment as the performance segment in response to a recording operation for the live room by the streamer side. Here, the recording operation for the live room may be a trigger operation of a recording button in the live room by the recording requester, and the specific details are not limited in this embodiment.

[0031] Furthermore, after responding to the recording operation for this live room, the recording requester generates a live room recording request for this live room and sends this live room recording request to the streamer side via the service side. After receiving the live room recording request, the streamer side presents prompt information on a presentation interface, where the prompt information is used to prompt the streamer user, who has requested a video recording, to whether or not to agree to the video recording by the recording requester corresponding to this viewer user. In response to the recording request being permitted, it is indicated that the streamer user agrees to the video recording by this viewer user, and at this time the streamer side sends recording consent information to the recording requester via the service side, and the recording requester, after receiving the recording consent information, acquires the recording segment as the performance segment.

[0032] Furthermore, in response to the recording request being not permitted, it is indicated that the streamer user does not agree to the viewer user recording the video, and at this time, the streamer side sends information that the streamer user does not agree to the recording to the recording requester via the service side, and this information that the streamer user does not agree to the recording is used to prompt the recording requester user that the streamer user does not agree to the video recording.

[0033] In this embodiment, when the streamer allows the recording request, the viewer user can record the live content that interests them, enhancing the interaction effect between users, and the viewer user can also create their own favorite videos.

[0034] In one embodiment, before obtaining the performance information of the live room and the interaction information of the live room, the method further includes obtaining a recording segment as a performance segment in response to a recording operation for the live room.

[0035] In this embodiment, when the video recording button is in the on state before the start of the live performance, the start of the live performance can be detected, that is, the recording segment of the live performance room (such as the segment between the start of the live performance and the temporary stop of the recording) is obtained as the performance segment.When the trigger operation of the video recording on button is detected during the live performance, the recording segment of the live performance room (such as the segment between the start of the recording and the temporary stop of the recording) is obtained as the performance segment.

[0036] In one embodiment, the step of acquiring performance information and interaction information for the live room includes the steps of acquiring a target performance segment corresponding to the live room, and using the performance information corresponding to the target performance segment as the performance information for the live room and the interaction information corresponding to the target performance segment as the interaction information for the live room. The target performance segment is a performance segment whose performance score corresponding to the live room is greater than a predetermined threshold, i.e., an excellent (high-quality) performance segment or a highlight performance segment. That is, the recorded segment may include multiple performance segments, and a performance segment among the multiple performance segments whose performance score is greater than a predetermined threshold may be set as the target performance segment. Here, the performance score of the performance segment may be acquired based on a known neural network scoring model, and the specific details are not limited.

[0037] In one embodiment, during the streamer user's performance, each performed sentence may be scored, and when the scores of consecutive sentences reach a preset score, the streamer user's performance segment may be determined to be a target performance segment. A score for each performance segment may be obtained based on the scores of the sentences corresponding to each performance segment, and the performance segment whose score is greater than the preset score may be determined as the target performance segment.

[0038] When the application program has a scoring scale of C, B, A, S, SS, SSS, the preset score may be set to S or SS, etc. It should be noted that this embodiment is not limiting and is merely for illustrative purposes of the preset scores.

[0039] Here, the "multiple" in the case where the scores of multiple simple sentences reach a preset score may be set according to the actual situation, for example, it may be three simple sentences or five simple sentences, and is not specifically limited in this embodiment.

[0040] In this embodiment, after determining that the streamer user's performance segment is the target performance segment, a step of obtaining performance information and interaction information corresponding to the target performance segment in the live room as live room performance information and live room interaction information, respectively, can be initiated, thus ensuring that the recorded performance audio is of high quality and further ensuring the quality of the video generated later.

[0041] In one embodiment, the step of obtaining a target performance segment corresponding to a live room includes the steps of obtaining a performance segment within a preset time period of the live room, dividing the performance segment into a plurality of target performance segments according to preset requirements, and performing a process of obtaining a target video template and subsequent processes for at least one target performance segment.

[0042] The preset time period may be a period from the start of recording to the end of recording, where the start of recording can be determined by referring to the description in the above embodiment, and the end of recording may be determined by the end of a live broadcast or by the time when a trigger operation on the video recording off button is detected.

[0043] Here, the pre-set requirements may include the recorded segment with the most likes, the recorded segment with the most comments, the recorded segment with the most number of users online, the recorded segment with the highest score, and so on.

[0044] Dividing the recording file into a plurality of recording segments according to preset requirements may include dividing the recording file into recording segments with the most likes, recording segments with the most comments, recording segments with the most online users, recording segments with the highest scores, etc. Accordingly, different target video templates may be adopted for each target performance segment.

[0045] In one embodiment, in response to a temporary stop operation of the performance recording, at least one performance segment identifier and corresponding at least one piece of performance information and at least one piece of interaction information are displayed. In response to a selection operation for the target performance information and target interaction information corresponding to a target performance segment identifier, the target performance information and target interaction information can be used as live room performance information and live room interaction information, respectively. The performance segment may be a recorded segment after the start of the performance recording and before the temporary stop of the performance recording, or may be a part of the recorded segment, such as a highlight segment of the recorded segment. The target performance segment identifier may be any performance segment identifier of the at least one performance segment identifier. The performance segment identifier may be a number, segment name, description, etc. corresponding to a performance segment. The target performance information is the performance information that is selected from the at least one piece of performance information, and the target interaction information is the interaction information that is selected from the at least one piece of interaction information. A user may select all or a portion of the performance information corresponding to one performance segment identifier as the performance information of the live room for generating the target video, or may select all or a portion of the performance information corresponding to multiple performance segment identifiers as the performance information of the live room for generating the target video, and a user may select all or a portion of the interaction information corresponding to one performance segment identifier as the interaction information of the live room for generating the target video, or may select all or a portion of the interaction information corresponding to multiple performance segment identifiers as the interaction information of the live room for generating the target video.For example, the at least one interaction information may be comment interaction information or like interaction information, and a user may select the comment interaction information and / or the like interaction information as interaction information in a live room to create a target video, thereby providing users with rich creative control, satisfying diverse user needs, and enhancing user experience.

[0046] S102: Obtain a target video template.

[0047] Here, the target video template may be understood as a template that needs to be used to generate a target video, and the target video template may be a script file, which is used to generate a target video by adding live room performance information and live room interaction information to a preset position of the video template.

[0048] In this embodiment, obtaining the target video template may be selecting any one or more video templates from a video template database.

[0049] In one embodiment, if there are multiple target performance segments, the multiple target performance segments may use the same target video template or different target video templates.

[0050] In one embodiment, the step of obtaining the target video template includes the steps of: displaying one or more candidate video templates in response to a template acquisition request; and using the selected candidate video template as the target video template in response to a selection operation on any one of the one or more candidate video templates.

[0051] Here, the step of responding to the template acquisition request may include a step of responding to the template acquisition request after detecting a trigger operation on the template acquisition button, and may further include a step of responding to the template acquisition request after detecting completion of acquisition of the performance information of the live room and the interaction information of the live room.

[0052] The candidate video template may be determined in response to a user request and may be a template that matches the performance information and interaction information of the live room. For example, a video template whose matching degree between the performance information and interaction information of the live room is greater than a preset threshold is determined as the candidate video template. Specifically, the client sends a template acquisition request to the service side. After receiving the template acquisition request, the service side determines a corresponding candidate template based on the performance information and interaction information of the live room, and then delivers and presents the candidate template to the client. The matching degree may be determined based on a known matching degree determination method, which will not be further described herein.

[0053] In this embodiment, candidate video templates are displayed according to the performance information of the live room and the interaction information of the live room, making it easy for the user to quickly select an appropriate video template.

[0054] S103: Generate a target video using the target video template according to the performance information of the live room and the interaction information of the live room.

[0055] In one embodiment, the performance information of the live room and the interaction information of the live room may be filled in at corresponding positions of the video template to generate a target video.

[0056] Here, at least one reserved position is set in the video template, and the at least one reserved position is used to fill in performance information and / or interaction information of the live room to generate the target video, and may also be used to fill in link addresses of the performance information and / or interaction information of the live room to generate the target video. At the same time, label information is set for each reserved position, and information matching the label information is filled in the corresponding reserved position. The label information may be the above-mentioned performance information or interaction information type, such as the streamer user's avatar, the streamer user's nickname, the performance lyrics corresponding to the target performance segment, the song title corresponding to the target performance segment, the single song interaction facial expression information, the number of single song comments, etc.

[0057] In this embodiment, after the live performance ends, the performance information of the live room and the interaction information of the live room can be filled in the corresponding positions of the video template to generate a target video, and after the single song ends, the performance information of the live room and the interaction information of the live room can be filled in the corresponding positions of the video template to generate a target video.

[0058] In one embodiment, the step of generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room includes the steps of generating target audio information and target screen information using the target video template based on audio information corresponding to the performance segment, music information corresponding to the performance segment, and interaction information corresponding to the performance segment, and generating the target video based on the target audio information and target screen information.

[0059] An embodiment of the present disclosure provides a video generation method, the video generation method including: acquiring performance information and interaction information of a live room; acquiring a target video template; and generating a target video using the target video template based on the performance information and interaction information of the live room. The present disclosure generates a video work by matching an appropriate scenario screen for pure audio live content (live content) to enhance the atmosphere of the audio work.

[0060] Based on the above embodiment, the embodiment of the present disclosure further optimizes the above video generation method, and as shown in FIG. 2, the optimized video generation method of the embodiment of the present disclosure mainly includes the following steps:

[0061] S201: Acquire performance information and interaction information of the live room.

[0062] S202: Obtain a target video template.

[0063] S203: Generate a target video using the target video template according to the performance information of the live room and the interaction information of the live room.

[0064] The implementation process and specific principles of S201-S203 are the same as S101-S103 in the above embodiment, and specific details can be found in the description of the above embodiment, and will not be further described here.

[0065] S204: Displaying video identifiers corresponding to the plurality of performance videos.

[0066] Here, the target video includes a plurality of performance videos.

[0067] Here, the video identifier may include characteristic information of the performance video, such as the performance video with the most likes, the performance video with the most comments, the performance video with the most online users, the performance video with the highest score, etc.

[0068] As shown in FIG. 3, the avatar of the streamer user is displayed in the video generation interface 300, and the name of the streamer user is displayed below the streamer user. In addition, the video generation interface 300 displays video identifiers corresponding to a plurality of performance videos that have already been generated, such as the performance video 301 with the most gifts received as shown in FIG. 3, the performance video with the most interactions, and the performance video corresponding to the chorus part.

[0069] Furthermore, in response to a user's sliding operation on the performance video, a different performance video may be displayed in an intermediate position on the video generation interface 300. For example, in Fig. 3, in response to a user's sliding operation on the performance video to the left, a performance video corresponding to the chorus portion may be displayed in an intermediate position on the video generation interface 300, and in response to a user's sliding operation on the performance video to the right, a performance video corresponding to the interaction portion may be displayed in an intermediate position on the video generation interface 300.

[0070] It should be noted that the performance video displayed in the middle position of the video generation interface 300 is determined as the selected performance video, and subsequent operations can be performed on the selected performance video.

[0071] S205: In response to a save operation on a target performance video corresponding to a target video identifier, save the target performance video, where the target video identifier is any one or more video identifiers among video identifiers corresponding to a plurality of performance videos.

[0072] Here, the target video identifier refers to a video identifier selected by a user and corresponding to a video the user wants to perform subsequent editing on, and the save button may be a virtual button (such as the "Save Draft" button in the video generation interface 300 shown in FIG. 3) or an entity button (such as a volume up button on a smart terminal).

[0073] For example, in response to a touch operation on a "Save Draft" button in the video generation interface 300, the target performance video displayed in the middle position of the video generation interface 300 is saved in a draft box. Furthermore, the target performance video in the draft box can be edited.

[0074] S206: In response to a posting operation on the target performance video corresponding to the target video identifier, the target performance video is posted.

[0075] Here, the posting button may be a virtual button (such as a "Post Now" button in the video generation interface 300 shown in FIG. 3), and the trigger operation may be any one of a click, a double click, and a touch.

[0076] For example, in response to a touch operation on the "Post Now" button on the video generation interface 300, the target performance video displayed in the middle position of the video generation interface 300 is saved and posted.

[0077] It should be noted that this embodiment does not limit the order in which steps S205 and S206 are executed, and S205 may be executed first, or S206 may be executed first, or only one of the steps may be executed.

[0078] In one embodiment, the video generating method according to the embodiment of the present disclosure further includes adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0079] Here, the live room link is a kind of hyperlink in web page creation, which can quickly anchor to the live room. For example, the live room link in this embodiment can be added to the image or name of the streamer user in the video generation interface 300, or can be added to the background image of the target video. It should be noted that this embodiment only exemplifies the adding location of the live room link, and is not limited thereto.

[0080] The method further includes the step of displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0081] After the video is posted, in response to an operation on the live room link by the viewing user, a live interface corresponding to the live room is displayed on the terminal interface of the viewing user.

[0082] Furthermore, in response to an operation on the live room link by a viewer user, the device inquires whether the live room is currently live, and if so, displays a live interface corresponding to the live room on the terminal interface of the viewer user.If the live room is not currently live, a live room similar to the live room is acquired and displayed on the terminal interface of the viewer user.

[0083] In this embodiment, by adding a live room link to the target video, users who re-access the video can quickly enter the live room, simplify the flow for users to enter the live room, and improve the user experience.

[0084] Based on the above embodiment, the step of generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room includes the steps of displaying a video editing interface in response to a video editing operation, obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface, and generating a target video using the target video template based on the display parameters of the performance information and / or the interaction information.

[0085] Here, the display parameters of the performance information and / or the interaction information may include background parameters (such as background pattern, background brightness, etc.), lyric display parameters (such as font size, color, etc.), comment display parameters (such as display position, display time length, etc.), clips of recorded segments, display parameters of additional stickers, etc.

[0086] Furthermore, the target video may be edited before the target video is generated, or after the target video is generated.

[0087] In this embodiment, by editing the target video, the user can edit the target video generated by a pure audio file, thereby enhancing the editability of the video and improving the user's usage experience.

[0088] As shown in FIG. 4 , a video editing interface 400 can be opened in an embodiment of the present disclosure, in which the name of a song corresponding to a currently performed segment is displayed at the top of the video editing interface 400, the streamer user's avatar is displayed in the middle, the hotness score at the end of the single song is displayed below the streamer user's avatar, and lyrics corresponding to a target video are displayed on the video editing interface 400. Comment information 401 corresponding to the target video is displayed above the streamer user's avatar, and the comment information includes the avatar of the user sending the comment and the comment content.

[0089] Furthermore, the target video is posted in response to a trigger operation on the "daily post" button 402. In response to a trigger operation on the "next" button 403, the video editing interface 400 displays the next content to be edited.

[0090] In this embodiment, the video background, the display style of lyrics, the display style of comments, the style of characters, the style of additional stickers and stickers, the cut of audio corresponding to the video, etc. may be edited.

[0091] In one embodiment, the step of obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface includes the steps of: displaying all comment styles corresponding to comments on the video editing interface in response to a trigger operation on a comment style button on the video editing interface; and replacing the current comment style with the selected comment style in response to a selection operation on a comment style.

[0092] Here, the selection operation for the comment style may be a touch operation for the comment style. Furthermore, as shown in Fig. 5, all of the comment styles are displayed in a comment style selection box corresponding to the video editing interface 400, and the current comment style is replaced with the selected comment style in response to the user's selection operation for the comment style.

[0093] Furthermore, as shown in Figure 5, in this embodiment, comments may be curated and a preset number of comments may be selected and displayed, for example, 10 comments may be selected and displayed from among the comments. Here, the preset number of comments may be a few comments with the highest number of likes, or may be a preset number of comments manually selected by a live user.

[0094] In one embodiment, the step of obtaining display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface includes the steps of: displaying all lyric styles corresponding to lyrics on the video editing interface in response to a trigger operation on a lyric style button on the video editing interface; and replacing the current lyric style with the selected lyric style in response to a selection operation on a lyric style.

[0095] Here, the selection operation for the lyrics style may be a touch operation for the lyrics style. Furthermore, as shown in Fig. 6, all lyrics styles are displayed in a lyrics style selection box corresponding to the video editing interface 400, and in response to the user's selection operation for the lyrics style, the current lyrics style is replaced with the selected lyrics style.

[0096] In one embodiment, the edited target video is posted, and the target video display interface after posting, as shown in FIG. 7, displays a cover picture or an avatar of the original singer corresponding to the song in the target video in the middle of the target video display interface 600, a hot value corresponding to the end of the single song is displayed below the middle, and lyrics corresponding to the audio segments are displayed in sequence below the hot value. A text description entered by the user when posting the video may also be displayed below the lyrics. A live room link is displayed in the upper left corner of the target video display interface 600, and a trigger operation on this link will jump to the live room corresponding to the streamer user. Related buttons that viewers can operate, such as a follow button, comment button, gift button, and forward button, corresponding to the target video are displayed in sequence at the bottom right of the target video display interface 600.

[0097] The embodiments of the present disclosure match appropriate live scenario screens for pure audio works, enhance the atmosphere of the audio works, and also enable editing of the target video, setting comment styles, adding text descriptions, replacing background pictures, adding stickers, etc., to enhance the taste of the target video.

[0098] FIG. 8 is a structural schematic diagram of a video generating device in an embodiment of the present disclosure. This embodiment can be applied to recording pure live audio from a live room to generate a video. This video generating device can be implemented in software and / or hardware, and can be disposed in an electronic device.

[0099] As shown in FIG. 8, a video generating device 80 according to an embodiment of the present disclosure mainly includes an information acquiring module 81, a template acquiring module 82, and a video generating module 83.

[0100] Here, the information acquisition module 81 is used to acquire performance information of the live room and interaction information of the live room, the template acquisition module 82 is used to acquire a target video template, and the video generation module 83 is used to generate a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0101] An embodiment of the present disclosure provides a video generating device for executing a flow of acquiring performance information and interaction information of a live room, acquiring a target video template, and generating a target video using the target video template based on the performance information and interaction information of the live room. In the embodiment of the present disclosure, a video work is generated by matching an appropriate scenario screen for pure audio live content to enhance the atmosphere of the audio work.

[0102] In one embodiment, the information acquisition module 81 includes: a performance segment acquisition unit for acquiring a target performance segment corresponding to a live room; and an information determination unit for using performance information corresponding to the target performance segment as performance information of the live room, and using interaction information corresponding to the target performance segment as interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0103] In one embodiment, the video generating device further includes a recording request sending module for sending a recording request for the live room to the service side in response to a recording operation for the live room, and for sending the recording request for the live room to the streamer side via the service side, and a recording segment acquisition module for acquiring a recording segment as a performance segment when the streamer side allows recording.

[0104] In one embodiment, the template acquisition module 82 includes a candidate template display unit for displaying one or more candidate video templates in response to a template acquisition request, and a target template determination unit for using the selected candidate video template as a target video template in response to a selection operation on any one of the one or more candidate video templates.

[0105] In one embodiment, the target video includes a plurality of performance videos, and the video generation device further includes a video identifier display module for displaying video identifiers corresponding to the plurality of performance videos, and a performance video operation module for saving the target performance video in response to a save operation for the target performance video corresponding to the target video identifier and / or posting the target performance video in response to a post operation for the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

[0106] In one embodiment, the device further includes a link adding module for adding a live room link to a target video and presenting the live room link in a playback process of the target video.

[0107] In one embodiment, the device further includes a live interface display module for displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0108] In one embodiment, the video generation module 83 includes an editing interface display unit for displaying a video editing interface in response to a video editing operation, a display parameter acquisition unit for acquiring display parameters of the performance information and / or the interaction information in response to an input operation on the video editing interface, and a target video generation unit for generating a target video using the target video template based on the display parameters of the performance information and / or the interaction information.

[0109] The video generation device according to the embodiments of the present disclosure can perform the steps performed in the video generation method according to the embodiments of the method of the present disclosure, and the performing steps and beneficial effects it has will not be further described here.

[0110] The modules or units may be implemented as software assemblies running on one or more general-purpose processors, or as hardware that performs certain functions or a combination thereof, such as programmable logic devices and / or application-specific integrated circuits. In some embodiments, the modules or units may be embodied in the form of a software product, which may be stored on a non-volatile storage medium that includes a program that causes a computing device (e.g., a personal computer, a server, a network device, a mobile terminal, etc.) to implement the methods described in the embodiments of the present disclosure. In other embodiments, the modules or units may be implemented in a single device or distributed across multiple devices. The functions of the modules or units may be integrated together or further divided into multiple sub-units.

[0111] FIG. 9 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. Referring specifically to FIG. 9 below, a structural schematic diagram for implementing an electronic device 900 according to an embodiment of the present disclosure is shown. The electronic device 900 according to an embodiment of the present disclosure may include, but is not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), in-vehicle devices (e.g., in-vehicle navigation devices), and wearable devices, as well as fixed devices such as digital TVs, desktop computers, and smart home devices. The electronic device shown in FIG. 9 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0112] 9, the electronic device 900 may include a processing unit 901 (e.g., a central processor, a graphics processor, etc.) that can perform various appropriate operations and processes based on programs stored in a read-only memory (ROM) 902 or loaded from a storage device 908 into a random access memory (RAM) 903 to implement the picture rendering method of the embodiments described in the present disclosure. The RAM 903 stores various programs and data necessary for the operation of the terminal device 900. The processing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0113] Typically, input devices 906 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 907 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc., storage devices 908 including, for example, a magnetic tape, hard disk, etc., and communication devices 909 may be connected to the I / O interface 905. The communication devices 909 may enable wireless or wired communication between the terminal device 900 and other devices to exchange data. While FIG. 9 shows the terminal device 900 having various devices, it should be understood that it is not necessary for the terminal device 900 to implement or include all of the devices shown. More or fewer devices may be implemented or included.

[0114] In particular, according to an embodiment of the present disclosure, the above processes with reference to the flowcharts can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, including a computer program stored on a non-transitory computer-readable medium, the computer program including program code for executing the method illustrated in the flowcharts, thereby implementing the page jump method described above. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, or may be installed from the storage device 908, or may be installed from the ROM 902. When the computer program is executed by the processing device 901, it performs the above functions defined by the methods of the embodiments of the present disclosure.

[0115] It should be noted that the computer-readable medium of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (such as an EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include, but is not limited to, a propagated data signal, either in baseband or as part of a carrier, having computer-readable program code embodied therein. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transporting a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained within the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

[0116] In some embodiments, clients and servers may communicate using any network protocol now known or later developed, such as, for example, HTTP (HyperText Transfer Protocol), and may be connected in communication (e.g., via a communications network) with digital data in any form or medium. Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), external networks (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any networks now known or later developed.

[0117] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device.

[0118] The computer-readable medium stores one or more programs, and when the one or more programs are executed by the terminal device, they cause the terminal device to perform the following steps: acquiring performance information of a live room and interaction information of the live room; acquiring a target video template; and generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0119] Optionally, when the one or more programs are executed by the terminal device, the terminal device can further execute other steps described in the above embodiments.

[0120] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., and may further include general procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely by the user computer, partially by the user computer, as a separate software package, partially by the user computer and partially by a remote computer, or entirely by a remote computer or a server. When referring to a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0121] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from the order marked in the figures. For example, two blocks shown in succession may actually be executed essentially in parallel or may be executed in the reverse order depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified functions or operations, or in a combination of dedicated hardware and computer instructions.

[0122] The units described in the embodiments of the present disclosure may be implemented in a software or hardware manner, and the names of the units do not necessarily constitute limitations on the units themselves.

[0123] The functionality described herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific general purpose products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0124] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or can store a program used by or in connection with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (such as EPROM or flash memory), optical fiber, compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

[0125] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, which includes the steps of obtaining performance information of a live room and interaction information of the live room, obtaining a target video template, and generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0126] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, in which the step of acquiring performance information of a live room and interaction information of the live room includes the steps of acquiring a target performance segment corresponding to the live room, and using the performance information corresponding to the target performance segment as the performance information of the live room, and using the interaction information corresponding to the target performance segment as the interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0127] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, which further includes: in response to a recording operation on a live room, sending a recording request for the live room to a service side, and sending the recording request for the live room to a streamer side via the service side; and if the streamer side allows recording, obtaining a recording segment as a performance segment.

[0128] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, wherein the step of acquiring a target video template includes the steps of: displaying one or more candidate video templates in response to a template acquisition request; and using the selected candidate video template as the target video template in response to a selection operation on any one of the one or more candidate video templates.

[0129] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, wherein the target video includes a plurality of performance videos, and the video generation method further includes the steps of displaying video identifiers corresponding to the plurality of performance videos, saving the target performance video in response to a save operation for the target performance video corresponding to the target video identifier, and / or posting the target performance video in response to a post operation for the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

[0130] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, which further includes a step of adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0131] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, the video generation method further including a step of displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0132] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation method, in which the step of generating a target video using the target video template based on performance information of the live room and interaction information of the live room includes the steps of: displaying a video editing interface in response to a video editing operation; acquiring display parameters of the performance information and / or display parameters of the interaction information in response to an input operation on the video editing interface; and generating a target video using the target video template based on the display parameters of the performance information and / or the display parameters of the interaction information.

[0133] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, which includes: an information acquisition module for acquiring performance information of a live room and interaction information of the live room; a template acquisition module for acquiring a target video template; and a video generation module for generating a target video using the target video template based on the performance information of the live room and the interaction information of the live room.

[0134] According to one or more embodiments of the present disclosure, the present disclosure provides a video generating device, wherein an information acquisition module includes: a performance segment acquisition unit for acquiring a target performance segment corresponding to a live room; and an information determination unit for using performance information corresponding to the target performance segment as performance information of the live room, and using interaction information corresponding to the target performance segment as interaction information of the live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

[0135] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, which further includes: a recording request sending module for sending a recording request for the live room to a service side in response to a recording operation for the live room, and sending the recording request for the live room to a streamer side via the service side; and a recording segment acquisition module for acquiring a recording segment as a performance segment when the streamer side allows recording.

[0136] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, wherein a template acquisition module includes: a candidate template display unit for displaying one or more candidate video templates in response to a template acquisition request; and a target template determination unit for using a selected candidate video template as a target video template in response to a selection operation on any one of the one or more candidate video templates.

[0137] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, wherein the target video includes a plurality of performance videos, and the video generation device further includes a video identifier display module for displaying video identifiers corresponding to the plurality of performance videos, and a performance video operation module for saving the target performance video in response to a save operation on the target performance video corresponding to the target video identifier and / or posting the target performance video in response to a post operation on the target performance video corresponding to the target video identifier, wherein the target video identifier is any one or more video identifiers among the video identifiers corresponding to the plurality of performance videos.

[0138] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, which further includes a link adding module for adding a live room link to the target video and presenting the live room link in a playback process of the target video.

[0139] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, the video generation device further including a live interface display module for displaying a live interface corresponding to the live room in response to an operation on the live room link.

[0140] According to one or more embodiments of the present disclosure, the present disclosure provides a video generation device, wherein a video generation module includes: an editing interface display unit for displaying a video editing interface in response to a video editing operation; a display parameter acquisition unit for acquiring display parameters of the performance information and / or display parameters of the interaction information in response to an input operation on the video editing interface; and a target video generation unit for generating a target video using the target video template based on the display parameters of the performance information and / or the display parameters of the interaction information.

[0141] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a memory for storing one or more programs; When the one or more programs are executed by the one or more processors, they cause the one or more processors to implement any one of the video generation methods according to the present disclosure.

[0142] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, the computer program being capable of implementing any one of the video generation methods described herein when executed by a processor.

[0143] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions that, when executed by a processor, implements the video generation method described above.

[0144] The above description merely describes the preferred embodiments of the present disclosure and the technical principles used. It should be understood by those skilled in the art that the scope of the present disclosure is not limited to the technical solution formed by the specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the spirit of the above disclosure, for example, technical solutions formed by replacing the above features with technical features having similar functions to those disclosed in the present disclosure (but not limited to).

[0145] It should be noted that although operations are illustrated in a particular sequence, this should not be understood as requiring that these operations be performed in the particular sequence or order shown. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination.

[0146] Although the present subject matter has been described using language specific to structural features and / or methodological logical operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. 1. A video generation method comprising: acquiring performance information of the live room and interaction information of the live room; obtaining a target video template; generating a target video using the target video template based on performance information of the live room and interaction information of the live room; Video generation method.

2. The step of acquiring performance information of the live room and interaction information of the live room includes: obtaining a target performance segment corresponding to the live room; 2. The video generation method of claim 1, further comprising the steps of: using performance information corresponding to the target performance segment as performance information of a live room; and using interaction information corresponding to the target performance segment as interaction information of a live room, wherein the target performance segment is a performance segment whose performance score corresponding to the live room is greater than a preset threshold.

3. a step of transmitting a recording request for the live room to a service side in response to a recording operation for the live room, and transmitting the recording request for the live room to a streamer side via the service side; The video generating method of claim 2, further comprising: if the recording request is permitted at a streamer side, obtaining a recording segment as the target performance segment.

4. The step of obtaining a target video template includes: displaying one or more candidate video templates in response to the template retrieval request; and in response to a selection operation on any one of the one or more candidate video templates, utilizing the selected candidate video template as a target video template.

5. The video generation method of claim 4, further comprising: determining one or more video templates whose matching degree with the performance information of the live room and the interaction information of the live room is greater than a specified threshold as the one or more candidate video templates.

6. the target video includes a plurality of performance videos; The method of claim 1 , further comprising displaying video identifiers corresponding to the plurality of performance videos.

7. storing the target performance video in response to a save operation on the target performance video corresponding to the target video identifier; or posting the target performance video in response to a posting operation on the target performance video corresponding to the target video identifier; and the target video identifier is any one or more of the video identifiers corresponding to the plurality of performance videos.

8. The video generating method of claim 1 , further comprising the step of adding a live room link of the live room to the target video in response to a link adding operation, and presenting the live room link in a playback process of the target video.

9. 10. The video generation method of claim 8, further comprising the step of displaying a live interface corresponding to the live room in response to a trigger operation on the live room link.

10. generating a target video using the target video template based on performance information of the live room and interaction information of the live room, displaying a video editing interface in response to a video editing operation; acquiring at least one of display parameters of the performance information and display parameters of the interaction information in response to an input operation on the video editing interface; The video generation method of claim 1, further comprising: generating the target video using the target video template based on at least one of display parameters of the performance information of the live room and display parameters of the interaction information of the live room, and the performance information of the live room and the interaction information of the live room.

11. The step of obtaining a display parameter of the performance information in response to an input operation on the video editing interface includes: displaying all of the lyric styles corresponding to the lyrics in the video editing interface in response to a trigger operation on a lyric style button of the video editing interface; and in response to a selection operation on the lyric style, replacing the current lyric style with the selected lyric style.

12. generating a target video using the target video template based on performance information of the live room and interaction information of the live room, The video generating method according to claim 1 , further comprising the step of filling in performance information of the live room and interaction information of the live room at designated positions of the target video template to obtain a target video.

13. 1. A video generation device, comprising: an information acquisition module for acquiring performance information of the live room and interaction information of the live room; a template acquisition module for acquiring a target video template; a video generation module for generating a target video using the target video template based on performance information of the live room and interaction information of the live room; Video generation device.

14. An electronic device, Memory and a processor coupled to the memory and configured to perform the video generation method of any one of claims 1 to 12 based on instructions stored in the memory, electronic equipment.

15. 13. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the video generation method of any one of claims 1 to 12.

16. 1. A video generation device, comprising: a processor; a memory storing a computer program; A video production device, wherein the computer program, when executed by the processor, causes the video production device to implement the video production method of any one of claims 1 to 12.

17. A computer program comprising: A computer program comprising instructions which, when executed by a processor, cause the processor to perform the video generation method of any one of claims 1 to 12.

Images