Video generation method and apparatus, and device and storage medium
By acquiring video generation requests and presenting material analysis information and editing operations, the problem of fragmented media editing tools and cross-type applications is solved, improving the efficiency and quality of video generation.
Patent Information
- Application Number
- PCT/CN2026/095685
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-08
- Filing Date
- 2026-05-08
- Publication Date
- 2026-11-12
AI Technical Summary
The number of generative model tools in existing media editing tools is large and scattered, making it difficult to find and maintain them. Furthermore, different tools are difficult to apply across different types, requiring users to switch between tools repeatedly, which is cumbersome and inefficient.
A video generation solution is provided that obtains video generation requests, presents material analysis information, and performs editing operations under preset conditions to generate video content, ensuring the relevance of editing operations to media content and improving the efficiency and quality of video generation.
It enables users to easily understand material analysis information and editing operations during the video generation process, ensuring the effectiveness and efficiency of the generated video content, and improving the efficiency and quality of media editing.
Smart Images

Figure CN2026095685_12112026_PF_FP_ABST
Abstract
Description
Video generation methods, apparatus, devices and storage media
[0001] This application claims priority to Chinese patent application No. 202510593526.3, filed on May 8, 2025, the entire contents of which are incorporated herein by reference. Technical Field
[0002] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to video generation methods, apparatus, devices, and computer-readable storage media. Background Technology
[0003] With the development of computer technology, people can share or access media content through internet platforms. Media editing tools have also gradually become important tools in people's lives; for example, people can use media editing tools to edit or generate video content and share it through media platforms. Summary of the Invention
[0004] In a first aspect of this disclosure, a video generation method is provided. The method includes: acquiring a video generation request associated with at least one piece of media content; presenting material analysis information related to the at least one piece of media content; presenting video editing information indicating multiple editing operations related to the material analysis information; and providing at least one piece of video content obtained based on the multiple editing operations.
[0005] In a second aspect of this disclosure, an apparatus for video generation is provided. The apparatus includes: a request acquisition module, a first information presentation module, a second information presentation module, and a first video viewing module, wherein the request acquisition module is configured to acquire a video generation request associated with at least one piece of media content; the first information presentation module is configured to present material analysis information associated with at least one piece of media content; the second information presentation module is configured to present video editing information indicating multiple editing operations associated with the material analysis information; and the first video viewing module is configured to provide at least one piece of video content obtained based on the multiple editing operations.
[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.
[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.
[0008] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.
[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description
[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:
[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;
[0012] Figures 2A to 2I illustrate example interfaces according to some embodiments of the present disclosure;
[0013] Figures 3A to 3F illustrate example interfaces according to some embodiments of the present disclosure;
[0014] Figure 4 illustrates a schematic diagram of an example implementation process of a video generation method according to some embodiments of the present disclosure;
[0015] Figure 5 shows a flowchart of an example process of a video generation method according to some embodiments of the present disclosure;
[0016] Figure 6 shows a schematic structural block diagram of an example apparatus for video generation according to some embodiments of the present disclosure; and
[0017] Figure 7 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation
[0018] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0019] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.
[0020] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
[0021] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.
[0022] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.
[0023] As mentioned above, media editing tools are gradually becoming important tools in people's lives, allowing them to edit or generate video content. With the increasingly widespread application of generative models, various generative models are now embedded in some media editing tools in order to improve media editing efficiency.
[0024] With the current technology, the number of tools associated with generative models in media editing applications is increasing, and the entry points are becoming more scattered. This makes it easy to confuse some editing tools or entry points, making it difficult to find tools and entry points, and the maintenance costs of tools are also gradually increasing.
[0025] In addition, different editing tools in related media editing applications have different model effects. For example, it is difficult to apply different editing tools across different types for video generation needs that require the use of models to generate text or speech and for video editing needs of long videos with complex narratives (e.g., longer than 1 minute). As a result, users with multiple scene production needs need to switch between different editing tools repeatedly, which is not only cumbersome but also inefficient.
[0026] Embodiments of this disclosure propose a video generation scheme. The scheme includes: acquiring a video generation request associated with at least one piece of media content; presenting material analysis information generated based on the at least one piece of media content; in response to the video generation request meeting preset conditions, presenting video editing information indicating multiple editing operations determined based on the material analysis information; and providing at least one piece of video content generated based on the multiple editing operations.
[0027] In this way, the embodiments of this disclosure can present material analysis information generated based on media content, and when the video generation request meets preset conditions, present multiple editing operations determined based on the material analysis information, so that users can understand the material analysis information and editing operations in a timely manner; then, at least one video content is generated based on multiple editing operations, which can effectively ensure the correlation between editing operations and media content, thereby ensuring the validity of the generated video content and ensuring the generation quality and efficiency of video content.
[0028] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.
[0029] Example Environment
[0030] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.
[0031] In this example environment 100, electronic device 110 may run an application 120 that supports video generation. Application 120 can be any suitable type of application for video generation, examples of which may include, but are not limited to, media editing applications, video generation applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.
[0032] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can present interface 150 for supporting video generation through application 120.
[0033] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).
[0034] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for the video generation application 120 in electronic device 110.
[0035] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.
[0036] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.
[0037] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.
[0038] Example Interaction
[0039] Figures 2A to 2I illustrate example interfaces 200A to 200I according to some embodiments of the present disclosure. Interfaces 200A to 200I may be provided, for example, by the electronic device 110 shown in Figure 1.
[0040] In some embodiments, the electronic device 110 may present an interactive interface and provide a generation entry point within that interface. As an example, the interactive interface may be the homepage of a media editing application, such as an editing interface; it may also be an interface presenting content including media content, text content, etc.; or it may be an interface enabling virtual social interaction, media playback, or video creation, etc. No limitation is made here.
[0041] In some embodiments, when triggered by a generation entry point, the electronic device 110 can present a material acquisition interface, such as interface 200A shown in Figure 2A; it can also present other interactive interfaces such as a media generation interface. As an example, the electronic device 110 can present a generation entry point in the media content playback interface, so that users can quickly create videos based on creative ideas obtained during the browsing of media content, thereby improving video generation efficiency.
[0042] In some embodiments, in response to the triggering of the generation entry, the electronic device 110 may verify the user's login information before presenting the material acquisition interface.
[0043] In some embodiments, during or after presenting the material acquisition interface, the electronic device 110 may first present a preset sample video for the user to preview. For example, the sample video may be a demonstration video showcasing a sample video generation process performed based on the generation entry point.
[0044] Taking the interface 200A shown in Figure 2A as an example, the electronic device 110 presents multiple candidate media content (or media materials) 201 in the interface 200A. As an example, the multiple candidate media content 201 presented in the interface 200A can be media content stored in the electronic device 110, or media content stored in the server 130 or other cloud, and there is no limitation here.
[0045] In some embodiments, the electronic device 110 may present at least one level of filter tags in the interface 200A. As an example, the electronic device 110 may present a first-level tag, which may be a source tag, such as local / cloud / online media library, etc.; then, based on the selection of any item in the first-level tag, the electronic device 110 may further present a second-level tag, which may be a type tag, such as all / video / image / live, etc., so that users can quickly find the media content they need.
[0046] In some embodiments, the electronic device 110 may present multiple candidate media content 201 by presenting a material cover. The electronic device 110 may present at least one piece of information about the candidate media content, such as the material image or the duration of the material, in the material cover.
[0047] As an example, when the cover image of candidate media content is triggered, the electronic device 110 can display a preview interface of the candidate media content. For instance, if the candidate media content is video footage, the electronic device 110 can play the video footage within the preview interface. As another example, if the candidate media content is image footage, the electronic device 110 can display a scaled-down version of the image footage at a preset specification within the preview interface, allowing the user to view more image details.
[0048] In some embodiments, the electronic device 110 may also display a selection identifier 201-1 at an associated position on the cover of the candidate media content (e.g., the upper right corner, lower right corner, upper left corner, or center). As an example, the selection identifier 201-1 may indicate whether the corresponding candidate media content has been selected. For instance, in response to receiving the first or an odd number of triggers to the selection identifier 201-1, the electronic device 110 determines that the candidate media content corresponding to the selection identifier is selected and can configure the selection identifier to a selected state, for example, by displaying a "√" element or a number element, where the number element indicates that the candidate media content is the Xth selected media content. As another example, in response to the selection identifier 201-1 not being triggered or being triggered an even number of times, the electronic device 110 can determine that the candidate media content corresponding to the selection identifier is not selected and can then configure the selection identifier to an unselected state, for example, by displaying an initial state.
[0049] In some embodiments, the electronic device 110 may also be configured with preset material selection conditions, such as material quantity conditions, material duration conditions, and material type conditions. As an example, the material quantity condition may include a maximum selection of 30 or 50 materials; the material duration condition may include the minimum duration of a single material, the maximum duration of a single material, and the minimum and maximum total duration of the selected materials; the material type may include allowed or disallowed material types, such as still images, videos, moving images, and audio, which are not limited here.
[0050] In some embodiments, the electronic device 110 presents a media panel 220 in response to the selection of at least one media content (e.g., media content 201a, 201b) from a plurality of candidate media content 201. In the media panel 220, the electronic device 110 presents the identification elements of the selected media content (e.g., identification elements 221a, 221b in FIG. 2A), such as the cover image of the selected media content.
[0051] As an example, the electronic device 110 can also deselect the media content corresponding to a marker element (e.g., 221a or 221b) presented in the media panel 220 based on a trigger.
[0052] In some embodiments, the electronic device 110 may also display material prompts (not shown) in the material panel 220, such as "Selecting XX materials will produce better results".
[0053] In some embodiments, the electronic device 110 may also present an information configuration entry 222 in the material panel 220 to obtain at least one piece of configuration information associated with video generation.
[0054] In some embodiments, the electronic device 110 may present an information configuration panel, such as the "Information Configuration" panel 230 in the interface 200B shown in FIG2B, in response to the information configuration entry 222 being triggered.
[0055] Referring to Figure 2B, in the information configuration panel 230, the electronic device 110 can provide at least one configuration control, such as a text input control 231, a subtitle configuration control 232, an audio configuration control 233, and a duration configuration control 234.
[0056] In some embodiments, the electronic device 110 can obtain prompt information input by the user via the text input control 231. As an example, the prompt information may correspond to at least one of the following: the creative theme, event description, editing requirements, etc., associated with the selected media content.
[0057] As shown in Figure 2B, the electronic device 110 can display the obtained prompt information in the text input box corresponding to the text input control 231.
[0058] In some embodiments, after receiving the prompt information, the electronic device 110 may also present multiple tag identifiers in the text input box corresponding to the text input control 231, such as "daily life", "travel", "food", "parenting", "family", etc., for the user to select. As an example, in response to the target tag identifier among the multiple tag identifiers being triggered, the electronic device 110 may add a tag element corresponding to that tag identifier to the prompt information entered by the user. For example, "#travel#" or "#food", etc.
[0059] In some embodiments, via the subtitle configuration control 232, the electronic device 110 can determine whether to enable the generation tool associated with the subtitle generation model. As an example, in response to the subtitle configuration control 232 being triggered, the electronic device 110 can determine that it is necessary to enable the generation tool associated with the subtitle generation model to generate corresponding subtitle text based on the selected media content; otherwise, the generation tool corresponding to the subtitle generation model is not enabled.
[0060] As an example, the subtitle configuration control 232 can be presented as "smart subtitles". The electronic device 110 can also present a control selection indicator in the subtitle configuration control 232 to indicate whether the subtitle configuration control 232 has been triggered.
[0061] In some embodiments, via audio configuration control 233, electronic device 110 can determine whether to enable the generation tool associated with the audio generation model. For example, in response to the triggering of the audio configuration control 233, electronic device 110 can determine that the generation tool associated with the audio generation model needs to be enabled to generate corresponding audio content for the selected media content; otherwise, the generation tool associated with the audio generation model is not enabled. For example, corresponding audio content can be generated based on text content associated with the media content; as another example, corresponding audio content can be generated based on subtitle text generated by a subtitle generation model.
[0062] As an example, the audio configuration control 233 can be presented as "intelligent voice-over". The electronic device 110 can also present a corresponding control selection identifier in the audio configuration control 233 to indicate whether the audio configuration control 233 has been triggered.
[0063] In some embodiments, via duration configuration control 234, electronic device 110 can determine the video duration to be generated based on the selected media content. As an example, electronic device 110 may present multiple duration labels in duration configuration control 234, such as “0-15s”, “15-30s”, “30-60s”, “1-2min”, etc.; it may also present a duration input panel to receive the user's input of the desired duration.
[0064] As described above, the electronic device 110 can receive at least one generation configuration information via the text input control 231, the subtitle configuration control 232, the audio configuration control 233, and the duration configuration control 234. Then, in combination with the media content selected in the material acquisition interface 200A (such as media content 201a, 201b, etc.), a corresponding video generation request can be generated.
[0065] Referring back to Figure 2A, the electronic device 110 can also display video creation controls 223 in the media panel 220. As an example, the media processing controls 223 can be presented as "Next," "Process Media," or "Generate Video," etc.
[0066] In some embodiments, the electronic device 110 obtains a corresponding video generation request based on the selected media content and at least one generation configuration information received via the information configuration entry 222, triggered by the video creation control 223.
[0067] In some implementations, after receiving a video generation request, the electronic device 110 can analyze and process the selected media content. For example, it can send the media content to a preset model for recognition and analysis, and present the corresponding material analysis information, as shown in Figure 2C. As an example, the preset model can be a pre-trained content understanding model.
[0068] In some embodiments, the electronic device 110 can send all the selected media content to the preset model, or it can perform frame extraction processing on the selected media content according to preset rules to obtain multiple material frames, and then send the multiple material frames to the preset model for recognition and analysis.
[0069] Referring to Figures 2A and 2C, when the video creation control 223 is triggered, the electronic device 110 can display the media analysis interface 200C. In the media processing interface 200C, the electronic device 110 can display a first content item 241 corresponding to the selected media content.
[0070] As an example, the first content item 241 can cycle through the selected media content. For instance, the electronic device 110 can use a scrolling display method to cycle through at least one cover image or video frame of the selected media content in the first content item 241.
[0071] In some embodiments, the electronic device 110 can also dynamically display the analysis progress 242 of the media content in real time within the media analysis interface 200C. For example, it can display "Media analysis in progress... XX%" or "Media analysis progress XX%", etc.
[0072] Referring again to Figure 2C, in the media analysis interface 200C, the electronic device 110 can also present media analysis information 243 for the selected media content. This media analysis information 243 can be the analysis results of a preset model for the selected media content. As an example, the media analysis information 243 may include at least one of the following: screen description information of the media content, number of segments, duration information, video creation theme, and video editing scheme.
[0073] In some embodiments, the electronic device 110 can start from 0% of the material analysis progress and gradually output the obtained material analysis information 243 as the analysis progress increases. For example, the electronic device 110 can present the material analysis information 243 in the form of streaming output.
[0074] In some embodiments, the electronic device 110 may present the material analysis progress 243 after the material analysis progress has reached 100%. For example, the electronic device 110 may present the material analysis information 243 in the form of full presentation or streaming output.
[0075] In response to the analysis progress reaching 100%, the electronic device 110 can perform editing and other processing on the media content based on the complete material analysis information for the selected media material to generate corresponding video content.
[0076] In some implementations, after receiving a video generation request, or after obtaining complete material analysis information 243, the electronic device 110 can also determine whether the video generation request meets preset conditions. As an example, preset conditions may include: the total duration of at least one selected media content is greater than a preset duration (e.g., 45 seconds, 1 minute, or 5 minutes), or the video generation request instructs the activation of video generation tools associated with the model, such as enabling subtitle generation tools and / or audio generation tools.
[0077] In some embodiments, in response to determining that a video generation request meets preset conditions, electronic device 110 may present video clip information associated with the selected media content, as shown in Figures 2D and 2E. The video clip information indicates multiple editing operations related to the material analysis information. In some examples, the video clip information associated with the media content may indicate multiple editing operations determined based on the material analysis information 243.
[0078] As an example, the editing operations that can be applied in this disclosure include, but are not limited to, at least one of the following: segmentation, highlight extraction, script generation, text generation, audio generation, special effects addition, music matching, and material splicing.
[0079] For example, a segmentation operation can instruct the cutting of at least one media segment from at least one piece of media content. For instance, a media segment can correspond to a separate storyboard segment.
[0080] The highlight extraction operation can instruct the extraction of at least one highlight shot from at least one media content or media segment. As an example, the highlight shot may correspond to a significant event or important scene in the media content or media segment, such as human movement, facial expression, or a static object in the scene.
[0081] The script generation operation can instruct the generation of script content associated with multiple media contents or multiple media segments for sorting multiple media contents or media segments.
[0082] The text generation operation can instruct the generation of text content associated with at least one piece of media content or media segment, in order to link it to the visual content within that media content or media segment. As an example, this text content can be used to generate subtitles or audio content for a video.
[0083] The audio generation operation can instruct the generation of audio content associated with at least one piece of media content or media segment, such as audio content corresponding to text content.
[0084] The effects addition operation can instruct the addition of clip effects associated with at least one piece of media content or media clip.
[0085] The music matching operation can instruct the determination of music content associated with at least one piece of media content. As an example, a search tool can be used to find at least one piece of music content that matches at least one piece of media content from local storage, a cloud server, or a preset music library, or at least one piece of music content can be generated based on at least one piece of media content or its material analysis information.
[0086] The material splicing operation can instruct media clips or storyboard clips associated with at least one piece of media content to be sorted in a preset order or based on script content and spliced together into a single video content.
[0087] According to the solution provided in this embodiment, when the video generation request meets preset conditions, in the material analysis interface 200C, the electronic device 110 can present multiple editing operations determined based on the material analysis information 243 after the material analysis progress reaches 100%. For example, the "highlight extraction" operation (highlight fragment extraction operation) 244 shown in FIG2D, and the "script writing" operation (script generation operation) 245 and the "finished film" operation (material splicing operation) 246 shown in FIG2E.
[0088] Referring to Figures 2D and 2E, the electronic device 110 can present at least one target media content from the selected media content, such as media content 244a, 244b, and 244c.
[0089] In some embodiments, the target media content presented by the electronic device 110 may be media content including highlight segments or media content that can be cropped into multiple media segments. In this scheme, corresponding to the "highlight extraction" operation 244, the presented target media content 244a, 244b, and 244c are all media content including at least one highlight segment.
[0090] Taking media content 244a as an example, electronic device 110 can sequentially present multiple video frames or scene segments of the media content 244a, and present highlight segments 244a-1 in a preset style. As an example, the preset style for presenting highlight segments can be at least one achievable highlighting style such as highlight display or bold selection.
[0091] The electronic device 110 can also present at least one segment information 244a-2 of the media content 244a at associated positions of multiple video frames or scene segments of the media content 244a. For example, segment information such as the number of highlight segments in the media content 244a, the duration of the highlight segments, and the total duration of the media segments corresponding to the media content 244a.
[0092] In addition, the electronic device 110 can also display at least one related prompt information, such as text information, theme information, title text, or content tags, corresponding to the media content 244a at an associated position (e.g., the upper left of the media segment).
[0093] Referring to Figure 2E, in the material analysis interface 200E, the electronic device 110 can present the script content 245 generated for the media segment corresponding to at least one media content (e.g., media content 244a, 244b, 244c, etc.) in the "script writing" operation 245.
[0094] In the "finishing" operation 246, the electronic device 110 can display finished product information corresponding to at least one piece of video content generated. For example, "Automatically generated XX results".
[0095] In the material analysis interface 200E, the electronic device 110 can also display a video preview entry 247. In response to the triggering of the video preview entry 247, the electronic device 110 can display at least one piece of video content generated in the "finished" operation 246.
[0096] It should be noted that, in the solution provided in this embodiment, the electronic device 110 can automatically jump to the video viewing interface to present at least one generated video content after the "finished" operation 246 is completed; it can also jump to the video viewing interface after triggering the video preview entry 247; or it can automatically jump to the video viewing interface to present the video draft corresponding to the aforementioned at least one complete editing operation before the "finished" operation 246 is completed or before the completion, after at least one complete editing operation has been presented in the material analysis interface 200C.
[0097] As an example, after the electronic device 110 presents at least one media content and its corresponding highlight segment under the highlight extraction operation 244 in the interface shown in FIG2D, or after presenting "Video rough cut is complete", it can automatically jump to the video viewing interface, such as interface 200F shown in FIG2F, to view the corresponding video draft.
[0098] Referring to Figure 2F, in interface 200F, electronic device 110 can display operation panel 250, in which a set of video content 260 is displayed. The set of video content 260 may include already generated video content, and may also include video drafts in the process of being generated.
[0099] Taking the video draft corresponding to video content 261 as an example, the electronic device 110 does not display a cover image in the content cover corresponding to video content 261, but can display a generation progress indicator, such as a dynamic or static progress icon, or a progress value (such as a percentage).
[0100] In some embodiments, the electronic device 110 may also display preview information 261a of the video draft on the interface 200F. As an example, the preview information 261a may be a progress indicator of the video draft generation, such as "Content generation in progress" and / or "XX%".
[0101] In some embodiments, if the music matching or audio generation process has been completed in the video draft, the electronic device 110 can also present a music description item 261-1 corresponding to the music content applied in the media content 261 on the interface 200F. As an example, the music description item 261-1 may provide at least one of the following: music identifier, music name, music composer, music source, etc.
[0102] In some embodiments, based on the video viewing interface shown in FIG2F, in response to the completion of the generation of video content 261, i.e., the processing progress of the video draft reaches 100%, the electronic device 110 can switch the video viewing interface to that shown in FIG2G.
[0103] Taking the editing operation shown in Figure 2E as an example, if the electronic device 110 jumps to the video viewing interface 200F shown in Figure 2F after the media content 244c is presented, the electronic device 110 continues to execute editing operations 245 and 246 in the background. In response to the completion of editing operation 246, the electronic device 110 updates the video draft in the video viewing interface 200F to present the interface 200G shown in Figure 2G, thereby presenting the generated video content 261.
[0104] As an example, the electronic device 110 can switch the preview information 261a corresponding to the video draft to the playback frame 261b corresponding to the video content 261. For instance, the electronic device 110 can play the video content 261 frame by frame in the area corresponding to the preview information 261a, and display the video duration corresponding to the video content 261 and the duration position corresponding to the currently playing video frame. In this area, the electronic device 110 can also receive user trigger operations to pause or resume playback of the video content 261.
[0105] As an example, the electronic device 110 can also switch the cover image corresponding to the video draft to the cover image of the video content 261. The cover image of the video content 261 can be the first frame image of the video content 261 or any intermediate video frame image.
[0106] In some embodiments, the electronic device 110 may also display information such as the title text and video duration of the video content 261 at the location corresponding to the cover image of the video content 261. As an example, the title text of the video content 261 may be generated by a model based on at least one of the following: at least one piece of media content corresponding to the video content 261; editing information corresponding to the at least one piece of media content; video creation scheme, etc. For example, material event information corresponding to at least one piece of media content, narration script or video theme generated by a video creation tool, or a creation theme associated with a video creation scheme generated by a preset model based on at least one piece of media content, etc.
[0107] In some embodiments, when the electronic device 110 is triggered by the cover image of the video content 261, it can play the video content 261 in the video preview area (e.g., the interface area where video frame 261b is located), and can also present an editing entry at the location corresponding to the cover image (e.g., the location covering the cover image). As an example, based on the triggering of the editing entry, the electronic device 110 can receive an editing request for the video content 261 and obtain at least one editing operation to update the video content 261.
[0108] In some embodiments, the electronic device 110 may present an editing interface for the target video content in response to the triggering of an editing entry corresponding to any video content in a set of video content 260.
[0109] Continuing with video content 261 as an example, electronic device 110 can present a set of editing controls in the editing interface corresponding to video content 261. As an example, a set of editing controls may include screen editing controls for screen content, text editing controls for text content such as subtitles and / or copywriting, sound editing controls for audio content such as background music or voice, and may also include control entries for other editing controls such as effects, templates, and stickers.
[0110] Accordingly, the electronic device 110 can receive editing information for at least one of the following aspects of the target video content via a set of editing controls: image content, text content, audio content, etc. The specific editing information and the editing process for that information can be found in relevant technical solutions and will not be elaborated upon here.
[0111] In some embodiments, the electronic device 110 may also respond to the triggering of the video authoring control 247 shown in FIG2E by directly presenting the interface 200G shown in FIG2G to present at least one completed video content.
[0112] Referring again to Figures 2F and 2G, the electronic device 110 may also provide a regeneration control 251 in the operation panel 250. As an example, the regeneration control 251 may be an update control for a previously presented set of video content 260. For example, the regeneration control 251 may be configured to present as "Update Video" or "Regenerate," etc. In response to the regeneration control 251 being triggered, the electronic device 110 may re-execute the video creation process based on the media content and / or configuration information determined in the interface 200A to provide a new set of video content 260.
[0113] In some embodiments, the electronic device 110 may also provide an information viewing control 252 in the operation panel 250. Through the information viewing control 252, the electronic device 110 can display creation information corresponding to the generated video content.
[0114] Taking video content 261 as an example, in response to the fact that video content 261 has not yet been fully generated, as shown in Figure 2F, the electronic device 110 can configure the presentation state of the information viewing control 252 to "Video generating". In response to the fact that video content 261 has been fully generated, as shown in Figure 2G, the electronic device 110 can switch the presentation state of the information viewing control 252 to a completion prompt message such as "Video generated successfully".
[0115] In some embodiments, regardless of whether the video content 261 is generated, the electronic device 110 can display an information viewing panel, such as the information viewing panel 270 in FIG2H, in response to the triggering of the information viewing control 252, to present the creation information corresponding to the video content. The creation information corresponding to the video content includes media content material analysis information and video editing information.
[0116] Referring to Figure 2H, in the information viewing panel 270, the electronic device 110 can display material analysis information corresponding to the video content. As an example, the material analysis information may include material analysis progress 271, such as displaying "Material analysis in progress…XX%" or "Material analysis progress XX%", etc.; it may also include material description content 272, etc. The material description content 272 may include at least one of the following: image description information of the media content, number of segments of the media content, duration information, video creation theme, video editing scheme, etc.
[0117] In the information viewing panel 270, the electronic device 110 can also display video clip information corresponding to the video content, such as video clip operation 273 shown in Figure 2H and video clip operations 274, 275, 276, and 277 shown in Figure 2I. The information shown in Figure 2I and the information shown in Figure 2H can be different information content within the same information stream. As an example, a user can view the information shown in Figure 2I by performing an up swipe operation in Figure 2H.
[0118] As an example, video editing operation 273 can be a highlight segment extraction operation. Specifically, the electronic device 110 can display at least one media segment 273a corresponding to media content in the video editing information corresponding to video editing operation 273.
[0119] In some embodiments, the electronic device 110 may sequentially present multiple video frames or scene segments of the media segment 273a, and present highlight segments therein in a preset style. As an example, the preset style for presenting highlight segments may be at least one achievable highlighting style such as highlight display, bold selection, etc.
[0120] The electronic device 110 can also present at least one piece of information about the media segment 273a at associated positions in multiple video frames or storyboard segments of the media segment 273a. For example, the title or theme text of the media content corresponding to the media segment 273a, the theme information corresponding to the media segment 273a, the descriptive information such as the event corresponding to the media segment 273a, the number of highlight segments in the media segment 273a, the duration of the media segment 273a, and other information.
[0121] Additionally, the electronic device 110 can display a confirmation flag corresponding to the media segment 273a at an associated location. In response to the triggering of this confirmation flag, the electronic device 110 can switch the confirmation flag to a confirmed state (selected state) to indicate that the media segment 273a and its highlight segment have been confirmed for use in generating video content; or, it can switch the confirmation flag to an unconfirmed state (unselected state) to indicate that the media segment 273a and its highlight segment have not been used in generating video content.
[0122] In some embodiments, video editing operation 274 may instruct script generation operation. Specifically, electronic device 110 may present at least one script content 274-1 corresponding to at least one media segment 273a in the video editing information corresponding to video editing operation 273.
[0123] As an example, the at least one script content 274-1 may include topic information, event description information, etc., corresponding to at least one media segment 273a.
[0124] In some embodiments, the electronic device 110 may also present an interactive control 274-2 for at least one script content 274-1 in the video editing information corresponding to the video editing operation 273.
[0125] As an example, interactive control 274-2 may include a like (“satisfied”) control, a dislike (“unsatisfied”) control, and may also include a text input control to receive feedback such as modification suggestions and supplementary information for at least one piece of script content 274-1.
[0126] As a supplement to Figure 2H, continuing to refer to Figure 2I, the video editing operation 275 can instruct the text generation operation. Specifically, the electronic device 110 can display the generated text and an interactive control 275a for that text in the video editing information corresponding to the video editing operation 273.
[0127] As an example, interactive control 275a may include a like ("satisfied") control and a dislike ("dissatisfied") control; it may also include a text input control to receive feedback such as modification suggestions and supplementary information for the generated copy text; and it may also include an editing entry to perform at least one editing operation on the copy text, such as audio generation or audio editing, through the editing entry.
[0128] In some embodiments, video editing operation 276 may instruct music matching operation. As an example, in the video editing information corresponding to video editing operation 275, electronic device 110 may present at least one piece of music content 276-1 that is matched and applied in the video content.
[0129] As an example, the electronic device 110 may present at least one associated descriptive information such as the cover art, music title, and author of the music content 276-1.
[0130] In some embodiments, the cover image of music content 276-1 can serve as a playback control for that music content 276-1. Based on the triggering of the cover image, the electronic device 110 can play or pause the music content corresponding to that cover image.
[0131] In some embodiments, the electronic device 110 may also provide a music changing entry 276-2 at the associated location of the music content 276-1. For example, the music changing entry 276-2 may be presented as "Change Music".
[0132] As an example, when music replacement entry 276-2 is triggered, electronic device 110 can display a candidate music list or a music search control. At least one candidate music item in the candidate music list can be music content locally stored on electronic device 110, music content stored in the cloud, or music content from a candidate music library. The music search control can be associated with at least one preset set of candidate music items. Through the candidate music list or music search control, electronic device 110 can obtain the target music content selected by the user and replace music content 276-1 accordingly.
[0133] In some embodiments, video editing operation 277 may instruct a segment splicing operation or a video integration operation. By performing the video editing operation 277, electronic device 110 can provide at least one complete video content generated.
[0134] As an example, in the video editing information corresponding to video editing operation 277, electronic device 110 can display a set of integrated video content 277a. As an example, electronic device 110 can also display a set of video covers corresponding to this set of video content 277a in the video editing information.
[0135] As described above, the solutions introduced in conjunction with interfaces 200A to 200I are exemplary solutions executed by electronic device 110 when the acquired video generation request meets preset conditions. If the video generation request does not meet the preset conditions, electronic device 110 may execute other solutions.
[0136] In some embodiments, if the video generation request received by the electronic device 110 indicates that the video generation tool associated with the model is not enabled, but the total duration of the selected media content exceeds a preset duration, the electronic device 110 still performs the above-described process to determine multiple editing operations based on the material analysis information 243 and generate at least one first video content accordingly. Additionally, the electronic device 110 may also determine at least one video template matching the selected media content based on the material analysis information 243, and generate at least one second video content based on the at least one video template and the selected media content, which is then presented together with the at least one first video content in the video viewing interface.
[0137] In some embodiments, for at least one second video content generated based on a video template, the electronic device 110 can also present a corresponding preview entry, editing entry, etc., and receive corresponding preview or editing operations. For example, at least one second video content can be updated via a regeneration control, or the creation information corresponding to any second video content can be viewed via the information viewing control 252. The creation information corresponding to the second video content may include material analysis information and / or template description information corresponding to the second video content.
[0138] In some embodiments, the electronic device 110 can be configured to generate a first number of video contents (e.g., 10 or 8, etc.) at a time. Taking a first number of 10 as an example, the electronic device 110 is configured to determine multiple editing operations corresponding to no more than 5 video creation schemes at a time based on material analysis information. Therefore, the number of first video contents generated by its video editing information is less than or equal to 5, for example, 4. Then, a set of video templates can be determined based on the media content, and a second set of video contents greater than or equal to 5 (e.g., 6) can be generated based on the video templates.
[0139] In practical applications, the sorting strategy used by the electronic device 110 to present at least one first video content and at least one second video content in the video preview interface can be referred to relevant technologies according to actual needs, and will not be elaborated here.
[0140] Figures 3A to 3F illustrate example interfaces 300A to 300F according to some embodiments of the present disclosure. Interfaces 300A to 300F may be provided, for example, by the electronic device 110 shown in Figure 1.
[0141] In some embodiments, the electronic device 110 may present an interactive interface and provide a generation entry point within that interface. As an example, the interactive interface may be the homepage of a media editing application, such as an editing interface; it may also be an interface presenting content including media content, text content, etc.; or it may be an interface enabling virtual social interaction, media playback, or video creation, etc. No limitation is made here.
[0142] In some embodiments, when triggered by a generation entry point, the electronic device 110 can present a material acquisition interface, such as interface 300A shown in Figure 3A; it can also present other interactive interfaces such as a media generation interface. As an example, the electronic device 110 can present a generation entry point in the media content playback interface, so that users can quickly create videos based on creative ideas obtained during the browsing of media content, thereby improving video generation efficiency.
[0143] In some embodiments, in response to the triggering of the generation entry, the electronic device 110 may verify the user's login information before presenting the material acquisition interface.
[0144] In some embodiments, during or after presenting the material acquisition interface, the electronic device 110 may first present a preset sample video for the user to preview. For example, the sample video may be a demonstration video showcasing a sample video generation process performed based on the generation entry point.
[0145] Taking the interface 300A shown in Figure 3A as an example, the electronic device 110 presents multiple candidate media content (or media materials) 301 in the interface 300A. As an example, the multiple candidate media content 301 presented in the interface 300A can be media content stored in the electronic device 110, or media content stored in the server 130 or other cloud, and there is no limitation here.
[0146] In some embodiments, the electronic device 110 may present at least one level of filter tags in the interface 300A. As an example, the electronic device 110 may present a first-level tag, which may be a source tag, such as local / cloud / online media library, etc.; then, based on the selection of any item in the first-level tag, the electronic device 110 may further present a second-level tag, which may be a type tag, such as all / video / image / live, etc., so that users can quickly find the media content they need.
[0147] In some embodiments, the electronic device 110 may present multiple candidate media content 301 by presenting a material cover. The electronic device 110 may present at least one piece of information about the candidate media content, such as the material image or the duration of the material, in the material cover.
[0148] As an example, when the cover image of candidate media content is triggered, the electronic device 110 can display a preview interface of the candidate media content. For instance, if the candidate media content is video footage, the electronic device 110 can play the video footage within the preview interface. As another example, if the candidate media content is image footage, the electronic device 110 can display a scaled-down version of the image footage at a preset specification within the preview interface, allowing the user to view more image details.
[0149] In some embodiments, the electronic device 110 may also display a selection identifier 301-1 at an associated position on the cover of the candidate media content (e.g., the upper right corner, lower right corner, upper left corner, or center). As an example, the selection identifier 301-1 may indicate whether the corresponding candidate media content has been selected. For instance, in response to receiving the first trigger or an odd number of triggers to the selection identifier 301-1, the electronic device 110 determines that the candidate media content corresponding to the selection identifier is selected and can configure the selection identifier to a selected state, for example, by displaying a "√" element or a number element, where the number element indicates that the candidate media content is the Xth selected media content. As another example, in response to the selection identifier 301-1 not being triggered or being triggered an even number of times, the electronic device 110 can determine that the candidate media content corresponding to the selection identifier is not selected and can then configure the selection identifier to an unselected state, for example, by displaying an initial state.
[0150] In some embodiments, the electronic device 110 may also be configured with preset material selection conditions, such as material quantity conditions, material duration conditions, and material type conditions. As an example, the material quantity condition may include a maximum selection of 30 or 50 materials; the material duration condition may include the minimum duration of a single material, the maximum duration of a single material, and the minimum and maximum total duration of the selected materials; the material type may include allowed or disallowed material types, such as still images, videos, moving images, and audio, which are not limited here.
[0151] In some embodiments, the electronic device 110 presents a media panel 320 in response to the selection of at least one media content (e.g., media content 301a, 301b) from a plurality of candidate media content 301. In the media panel 320, the electronic device 110 presents the identification elements of the selected media content (e.g., identification elements 321a, 321b in FIG. 3A), such as the cover image of the selected media content.
[0152] As an example, the electronic device 110 can also deselect the media content corresponding to a marker element (e.g., 321a or 321b) presented in the media panel 320 based on a trigger.
[0153] In some embodiments, the electronic device 110 may also display material prompts (not shown) in the material panel 320, such as "Selecting XX materials will yield better results".
[0154] In some embodiments, the electronic device 110 may also present an information configuration entry 322 in the material panel 320 to obtain at least one piece of configuration information associated with video generation.
[0155] In some embodiments, the electronic device 110 may display an information configuration panel in response to the information configuration entry 322 being triggered, such as the "Information Configuration" panel 330 in the interface 300B shown in FIG3B.
[0156] Referring to Figure 3B, in the information configuration panel 330, the electronic device 110 can provide at least one configuration control, such as a text input control 331, a subtitle configuration control 332, an audio configuration control 333, and a duration configuration control 334.
[0157] In some embodiments, the electronic device 110 can obtain prompt information input by the user via the text input control 331. As an example, the prompt information may correspond to at least one of the following: the creative theme, event description, editing requirements, etc., associated with the selected media content.
[0158] As shown in Figure 3B, the electronic device 110 can display the obtained prompt information in the text input box corresponding to the text input control 331.
[0159] In some embodiments, the electronic device 110 may also present multiple tag identifiers, such as "daily life", "travel", "food", "parenting", "family", etc., in the text input box corresponding to the text input control 331 for the user to select. As an example, in response to the target tag identifier among the multiple tag identifiers being triggered, the electronic device 110 may add a tag element corresponding to that tag identifier to the prompt information entered by the user. For example, "#travel#" or "#food".
[0160] In some embodiments, via the subtitle configuration control 332, the electronic device 110 can determine whether to enable the generation tool associated with the subtitle generation model. As an example, in response to the subtitle configuration control 332 not being triggered, the electronic device 110 can determine that the generation tool associated with the subtitle generation model is not enabled, that is, no subtitle text is generated or subtitle content is added during the generation of video content.
[0161] As an example, the subtitle configuration control 332 can be presented as "smart subtitles". The electronic device 110 can also present a control selection indicator in the subtitle configuration control 332 to indicate whether the subtitle configuration control 332 has been triggered.
[0162] In some embodiments, via audio configuration control 333, electronic device 110 can determine whether to enable the generation tool associated with the audio generation model. As an example, in response to the audio configuration control 333 not being triggered, electronic device 110 can determine that the generation tool associated with the audio generation model is not enabled, that is, no additional audio content is generated or added during the video content generation process.
[0163] As an example, the audio configuration control 333 can be presented as "intelligent voice-over". The electronic device 110 can also present a corresponding control selection identifier in the audio configuration control 333 to indicate whether the audio configuration control 333 has been triggered.
[0164] In some embodiments, via duration configuration control 334, electronic device 110 can determine the video duration to be generated based on the selected media content. As an example, electronic device 110 may present multiple duration labels in duration configuration control 334, such as “0-15s”, “15-30s”, “30-60s”, “1-2min”, etc.; it may also present a duration input panel to receive the user's input of the desired duration.
[0165] As described above, the electronic device 110 can receive at least one generation configuration information via the text input control 331, the subtitle configuration control 332, the audio configuration control 333, and the duration configuration control 334. Then, in combination with the media content selected in the material acquisition interface 300A (such as media content 301a, 301b, etc.), a corresponding video generation request can be generated.
[0166] Referring back to Figure 3A, the electronic device 110 can also display video creation controls 323 in the media panel 320. As an example, the media processing controls 323 can be presented as "Next," "Process Media," or "Generate Video," etc.
[0167] In some embodiments, the electronic device 110 obtains a corresponding video generation request based on the triggering of the video creation control 323, the selected media content, and at least one generation configuration information received via the information configuration entry 322.
[0168] In some embodiments, the user may not trigger the text input control 331, subtitle configuration control 332, audio configuration control 333, and duration configuration control 334. That is, the user may not input any configuration information using the information configuration entry 322. In this case, the electronic device 110, based on the triggering of the video creation control 323, can obtain the corresponding video generation request solely based on the selected media content.
[0169] In some embodiments, the user may only trigger the duration configuration control 334, that is, without entering text configuration information or enabling the subtitle configuration tool or audio configuration tool. In this case, the electronic device 110 can obtain the configuration information without prompt text and use it to obtain the corresponding video generation request in conjunction with the selected media content.
[0170] In some embodiments, a user can input text configuration information via text configuration control 331, but without enabling the subtitle configuration tool or audio configuration tool. The electronic device 110 can then obtain the configuration information carrying the prompt text and, based on this, obtain the corresponding video generation request in conjunction with the selected media content.
[0171] In some implementations, after receiving a video generation request, the electronic device 110 can analyze and process the selected media content. For example, it can send the media content to a preset model for recognition and analysis, and present the corresponding material analysis information, as shown in Figure 3C. As an example, the preset model can be a pre-trained content understanding model.
[0172] In some embodiments, the electronic device 110 can send all the selected media content to the preset model, or it can perform frame extraction processing on the selected media content according to preset rules to obtain multiple material frames, and then send the multiple material frames to the preset model for recognition and analysis.
[0173] Referring to Figures 3A and 3C, when the video creation control 323 is triggered, the electronic device 110 can display the media analysis interface 300C. In the media processing interface 300C, the electronic device 110 can display the first content item 341 corresponding to the selected media content.
[0174] As an example, the first content item 341 can cycle through the selected media content. For instance, the electronic device 110 can use a scrolling display method to cycle through at least one cover image or video frame of the selected media content in the first content item 341.
[0175] In some embodiments, the electronic device 110 can also dynamically display the analysis progress 342 of the media content in real time within the media analysis interface 300C. For example, it can display "Media analysis in progress... XX%" or "Media analysis progress XX%", etc.
[0176] Referring again to Figure 3C, in the media analysis interface 300C, the electronic device 110 can also present media analysis information 343 for the selected media content. This media analysis information 343 can be the analysis results of a preset model for the selected media content. As an example, the media analysis information 343 may include at least one of the following: image description information of the media content, number of segments, duration information, video creation theme, and video editing scheme.
[0177] In some embodiments, the electronic device 110 can start from 0% of the material analysis progress and gradually output the obtained material analysis information 343 as the analysis progress increases. For example, the electronic device 110 can present the material analysis information 343 in the form of streaming output.
[0178] In some embodiments, the electronic device 110 may present the material analysis progress 343 after the material analysis progress has reached 100%. For example, the electronic device 110 may present the material analysis information 343 in the form of full presentation or streaming output.
[0179] In response to the analysis progress reaching 100%, the electronic device 110 can perform editing and other processing on the media content based on the complete material analysis information for the selected media material to generate corresponding video content.
[0180] In some implementations, after receiving a video generation request, or after obtaining complete material analysis information 343, the electronic device 110 can also determine whether the video generation request meets preset conditions. As an example, preset conditions may include: the total duration of at least one selected media content is greater than a preset duration (e.g., 45 seconds, 1 minute, or 5 minutes, etc.), or the video generation request instructs the activation of video generation tools associated with the model, such as enabling subtitle generation tools and / or audio generation tools, etc.
[0181] In some embodiments, in response to the total duration of the media content associated with the video generation request being less than or equal to a preset duration, and the video generation request indicating that the video generation tool associated with the model is not enabled, the electronic device 110 can determine that the video generation request does not meet the preset conditions. In this case, the electronic device 110 can determine at least one video template matching the selected media content based on the material analysis information 343, and generate at least one piece of video content based on the at least one video template and the selected media content.
[0182] In some embodiments, the electronic device 110 may also present at least one video content generated based on a video template in a video viewing interface 300D or 300E, as shown in Figures 3D and 3E.
[0183] Referring to Figures 3D and 3E, the electronic device 110 can display an operation panel 350, and in the operation panel 350, a set of video content 360 generated based on a video template is displayed.
[0184] Taking video content 365 from a set of generated video content 360 as an example, electronic device 110 can display the cover image of video content 365. As an example, the cover image of video content 365 can be associated with the preview entry of that video content 365. For example, electronic device 110 can play video content 365 in response to a trigger on the cover image. Exemplarily, electronic device 110 can play video frame 365-1 of video content 365 frame by frame in the preview area of video viewing interface 300D or 300E.
[0185] As an example, the cover image of video content 365 can be the first frame of the video content 365 or any intermediate video frame.
[0186] In some embodiments, the electronic device 110 may also display information such as the title text and video duration of the video content 365 at a location associated with the cover image. As an example, the title text of the video content 365 may be generated by a model based on at least one of the following: at least one piece of media content corresponding to the video content 365; editing information corresponding to the at least one piece of media content; a video creation scheme, etc. For example, material event information corresponding to at least one piece of media content, narration text or video theme generated by a video creation tool, or a creation theme associated with a video creation scheme generated by a preset model based on at least one piece of media content, etc.
[0187] In some embodiments, in response to the triggering of a preview entry (e.g., a cover image) of any video content, the electronic device 110 may also present a video editing entry for the video content at a location associated with the preview entry, such as the location covering the cover image. Through the editing entry, the electronic device 110 can receive editing requests for the video content and present an editing interface for the video content.
[0188] Continuing with video content 365 as an example, electronic device 110 can present a set of editing controls in the editing interface corresponding to video content 365. As an example, a set of editing controls may include screen editing controls for screen content, text editing controls for text content such as subtitles and / or copywriting, sound editing controls for audio content such as background music or voice, and may also include control entries for other editing controls such as effects, templates, and stickers.
[0189] Accordingly, the electronic device 110 can receive editing information for at least one of the following aspects of the target video content via a set of editing controls: image content, text content, audio content, etc. The specific editing information and the editing process for that information can be found in relevant technical solutions and will not be elaborated upon here.
[0190] In some embodiments, the electronic device 110 may also display a music description item 365-2 corresponding to the music content applied in the media content 365 on the interface 300D or 300E. As an example, the music description item 365-2 may provide at least one of the following: music identifier, music name, music composer, music source, etc.
[0191] Referring to Figure 3D, the electronic device 110 can display multiple video tags 351 corresponding to at least one video content 360 on the operation panel 350. As an example, the multiple video tags 351 may include template tags corresponding to the video template applied to generate the at least one video content 360.
[0192] In some embodiments, if the electronic device 110 determines that the configuration information associated with the video generation request does not include text prompts, the video requirements that can be determined based on the video generation request are fewer. Therefore, the number or type of video templates that can be determined to match the selected media content based solely on the material analysis information 343 will be larger, resulting in a wider variety of video content types generated by the electronic device 110 based on the determined video templates. In this case, the electronic device 110 can reference the template tag corresponding to the video template as a video tag and associate it with at least one generated video content 360, so that by triggering the corresponding video tag, at least one video content 360 can be classified, filtered, or otherwise processed.
[0193] Referring to Figures 3D and 3E, the electronic device 110 provides an information viewing control 352 in the operation panel 350. Through the information viewing control 352, the electronic device 110 can display creation information corresponding to the generated video content.
[0194] Taking video content 365 as an example, electronic device 110 can display the information viewing control 352 as a completion prompt message such as "Video has been generated".
[0195] In some embodiments, in response to the information viewing control 352 being triggered, the electronic device 110 can display an information viewing panel, such as the information viewing panel 370 in FIG3F, to display the creation information corresponding to the video content. The creation information corresponding to the video content includes at least the media content material analysis information.
[0196] Referring to Figure 3F, in the information viewing panel 370, the electronic device 110 can display material analysis information corresponding to the video content. As an example, the material analysis information may include analysis status information 371, such as "Material analysis in progress…XX%" or "Material analysis complete" or "Generated successfully," etc.; it may also include material description content 372, etc. The material description content 372 may include at least one of the following: image description information of the media content, number of segments of the media content, duration information, video creation theme, video editing scheme, etc.
[0197] In the information viewing panel 370, the electronic device 110 can also display interactive controls 373 for the material description content 372.
[0198] As an example, interactive control 373 may include a like ("satisfied") control and a dislike ("dissatisfied") control.
[0199] In some embodiments, the interactive control 373 may also include a text input control to receive feedback such as modification suggestions and supplementary information regarding the material description content 372.
[0200] Referring back to Figure 3E, in the operation panel 350, the electronic device 110 may also provide a regeneration control 353. As an example, the regeneration control 353 may be an update control for a previously presented set of video content 360. For example, the regeneration control 353 may be configured to present as "Update Video" or "Regenerate," etc. In response to the regeneration control 353 being triggered, the electronic device 110 may re-execute the video creation process based on the media content and / or configuration information determined in the interface 300A to provide a new set of video content 360.
[0201] In some embodiments, the electronic device 110 may also present additional generation controls in the operation panel 350. As an example, the electronic device 110 may present additional generation controls at a location associated with a set of video content 360, for example, at a location after a set of video content 360.
[0202] In response to the triggering of the additional generation control, the electronic device 110 can generate at least one additional video content based on the video generation request obtained in the interface 300A, in addition to a set of video content 360, to be presented together with a set of video content 360, so as to provide more video content and give users more choices.
[0203] Example process
[0204] Figure 4 shows a flowchart of an example implementation process 400 of a video generation method according to some embodiments of the present disclosure. Process 400 can be implemented at an electronic device 110. Process 400 will now be described with reference to Figure 1.
[0205] Referring to Figure 4, in box 410, electronic device 110 determines the trigger generation entry and then executes box 420.
[0206] In box 420, electronic device 110 acquires media content. As an example, media content 201a and 201b can be acquired via interface 200A shown in Figure 2A.
[0207] In box 430, electronic device 110 triggers a video generation process based at least on the acquired media content.
[0208] In some embodiments, after acquiring media content, the electronic device 110 can directly obtain a video generation request based on the acquired media content and execute box 430 to trigger the video generation process.
[0209] In some embodiments, after acquiring media content, the electronic device 110 may first execute box 425.
[0210] In box 425, electronic device 110 receives configuration information (Prompt) input by the user.
[0211] Then, based on the acquired media content and the received configuration information, electronic device 110 generates a video generation request. Based on the video generation request, execution box 430 is then triggered to initiate the video generation process.
[0212] After the video generation process is triggered, electronic device 110 executes box 441.
[0213] In box 441, electronic device 110 determines whether the video generation request corresponds to the selection of a generation tool. If yes, it executes box 451; otherwise, it executes box 442.
[0214] In box 451, the electronic device 110, based on the determined video generation request corresponding to the selected generation tool, triggers the algorithm generation process, processes the media content obtained in box 420 based on the preset algorithm, and executes box 461.
[0215] In some embodiments, the generation tool selected in the video generation request may include at least one of a subtitle generation tool, an audio generation tool, or other pre-configured content generation tools.
[0216] In some embodiments, the preset algorithm may include a preset generation algorithm or a generative model built based on the preset generation algorithm.
[0217] As an example, electronic device 110 in frame 451 can identify and analyze the acquired media content based on a preset algorithm to obtain material analysis information corresponding to the media content; then, based on the material analysis information, it can determine multiple editing operations corresponding to at least one video creation scheme, and then generate at least one first video content corresponding to at least one video creation scheme based on the multiple editing operations, as the algorithm generation result.
[0218] In box 461, electronic device 110 presents the algorithm-generated result, namely at least one piece of first video content generated by executing box 451. As an example, electronic device 110 may present at least one piece of first video content in a video viewing interface.
[0219] Return to box 441. If the video generation request corresponds to not selecting any generation tool, electronic device 110 executes box 442.
[0220] In box 442, electronic device 110 determines the total duration of the acquired media content and whether the total duration is greater than a preset duration, such as 60 seconds. If so, boxes 452 and 462 are executed; otherwise, box 453 is executed.
[0221] In box 452, after the electronic device 110 determines that the total duration of the media content is greater than the preset duration, it triggers a generation process based on templates and algorithms.
[0222] During this process, the electronic device 110 generates at least one first video content based on a preset algorithm and generates at least one second video content based on a video model, and uses at least one first video content and at least one second video content as the generation result of this process.
[0223] In some embodiments, the electronic device 110 processes the acquired media content based on a preset algorithm to obtain material analysis information corresponding to the media content, and determines multiple editing operations corresponding to at least one video creation scheme, and then edits the media content based on the multiple editing operations to generate at least one first video content.
[0224] In some embodiments, the electronic device 110 further determines at least one video template that matches the media content based on the media content or the material analysis information corresponding to the media content, and then generates at least one second video content based on the at least one video template and the media content.
[0225] In box 462, electronic device 110 presents the generated results based on templates and algorithms. As an example, electronic device 110 may present at least one first video content and at least one second video content in a video viewing interface.
[0226] If the electronic device 110 determines that the video generation request is not associated with any generation tool and its total duration is not greater than the preset duration, then execute box 453.
[0227] In box 453, electronic device 110 triggers a template-based video generation process based on a video generation request and executes box 463.
[0228] After the electronic device 110 triggers the template-based video generation process, it can determine at least one video template that matches the media content based on the media content or the material analysis information corresponding to the media content. Then, it processes the media content based on the at least one video template to generate at least one piece of second video content.
[0229] In box 463, electronic device 110 presents at least one piece of second video content generated in box 453. As an example, electronic device 110 may present the at least one piece of second video content in a video viewing interface.
[0230] In some embodiments, the electronic device 110 may continue executing block 470 after executing block 463.
[0231] In box 470, electronic device 110 determines whether the video generation request is associated with receiving configuration information (Prompt). For example, electronic device 110 can determine whether configuration information has been received by determining whether box 425 has been executed.
[0232] If no configuration information is received, electronic device 110 may execute box 475; if configuration information is received, electronic device 110 may execute boxes 480 and 490.
[0233] In box 475, electronic device 110 does not support loading additional video content in the video viewing interface. As an example, in this video viewing interface, electronic device 110 does not provide additional generation controls to prevent loading video content beyond at least one second piece of video content.
[0234] In box 480, after confirming that a prompt has been received, electronic device 110 can support loading more video content in the video viewing interface, receive the trigger for the process of loading more video content, and then execute box 490.
[0235] As an example, the electronic device 110 can present an additional generation control in the video viewing interface and receive a trigger on the additional generation control to generate at least one additional video content based on the acquired media content, as a supplement to at least one second video content.
[0236] In box 490, electronic device 110 determines at least one media template that matches the acquired media content, and generates at least one additional video content that is different from at least one second video content based on the media template, as supplementary video content to the second video content.
[0237] As an example, the electronic device 110 can display at least one piece of additional video content generated in the video viewing interface. For instance, the additional video content can be displayed after at least one piece of second video content.
[0238] Figure 5 shows a flowchart of an example process 500 of a video generation method according to some embodiments of the present disclosure. Process 500 can be implemented at an electronic device 110. Process 500 will now be described with reference to Figure 1.
[0239] As shown in Figure 5, in box 510, electronic device 110 obtains a video generation request, which is associated with at least one piece of media content.
[0240] As an example, electronic device 110 can obtain a corresponding video generation request based on the triggering of the material processing control 223 shown in Figure 2A. At least one piece of media content can refer to the selected media content 201a and 201b in Figure 2A.
[0241] In frame 520, electronic device 110 presents material analysis information generated based on at least one piece of media content.
[0242] As an example, the material analysis information can be referenced to material analysis information 243 shown in Figure 2C or material analysis information 343 shown in Figure 3C.
[0243] In frame 530, electronic device 110 presents video clip information that indicates multiple editing operations determined based on material analysis information.
[0244] As an example, multiple editing operations can be referenced to the "highlight extraction" operation 244 shown in Figure 2D and the "script writing" operation 245 and "finished" operation 246 shown in Figure 2E.
[0245] In frame 540, electronic device 110 provides at least one first video content generated based on multiple editing operations.
[0246] As an example, at least one piece of first video content can refer to a set of video content 260 shown in interface 200F.
[0247] In this way, the embodiments of this disclosure can present material analysis information generated based on media content, and present multiple editing operations determined based on the material analysis information, which can facilitate users to understand the material analysis information and editing operations in a timely manner; then, at least one video content is generated based on multiple editing operations, which can effectively ensure the correlation between editing operations and media content, thereby ensuring the validity of the generated video content and ensuring the generation quality and efficiency of video content.
[0248] In some embodiments, obtaining a video generation request includes: obtaining at least one piece of media content via a first interactive interface; obtaining generation configuration information via at least one input control in the first interactive interface; and obtaining a video generation request based on at least one piece of media content and the generation configuration information.
[0249] As an example, the first interactive interface can be a material selection interface, such as interface 200A shown in Figure 2A. At least one media content can be media content 201a and 201b, and the input control can be information configuration entry 222.
[0250] In this way, the embodiments of this disclosure can obtain generation configuration information and determine video generation requests in combination with the obtained media content, effectively ensuring the accuracy and validity of the video generated based on the video generation request and improving video generation efficiency.
[0251] In some embodiments, obtaining generation configuration information via at least one input control in a first interactive interface includes at least one of the following: obtaining prompt information input by the user via the first input control; determining whether to enable the generation tool associated with the model via the second input control; and determining at least one parameter of the video content to be generated via the third control.
[0252] In this way, the embodiments of this disclosure support the acquisition of various configuration information, which can effectively improve the accuracy of video generation requests and the validity of generated video content, thereby improving video generation efficiency.
[0253] In some embodiments, the generation tool includes a first generation tool and / or a second generation tool. The first generation tool is configured to generate subtitle content using a model; the second generation tool is configured to generate speech content using a model.
[0254] In this way, the embodiments of this disclosure can generate subtitles and audio content associated with media content based on the selection of generation tools, effectively ensuring the relevance of subtitles and audio content to media content, enriching video content, taking into account the efficiency of video content generation, and improving user experience.
[0255] In some embodiments, presenting video clip information includes: presenting video clip information in response to a video generation request meeting preset conditions, wherein the preset conditions include: the total duration of at least one media content being greater than a preset duration; or, the video generation request instructing the activation of a generation tool associated with the model.
[0256] In this way, embodiments of the present disclosure can present video editing information when it is determined that the generation request meets preset conditions, and can quickly determine the generation method of video content, thereby improving the generation efficiency of video content.
[0257] In some embodiments, process 500 further includes: in response to a video generation request not being instructed to enable a generation tool, electronic device 110 provides at least one second video content generated based on a video template and at least one media content, the video template being determined based on at least one media content.
[0258] In this way, the embodiments of this disclosure can quickly determine a video template that matches the media content without enabling the generation tool, ensuring the compatibility between the video template and the media content, and generating corresponding video content based on the video template, thereby ensuring video generation quality and generation efficiency.
[0259] In some embodiments, the multiple editing operations include at least one of the following: a first editing operation instructing the cutting of multiple media segments from at least one media content; a second editing operation instructing the determination of music content associated with at least one media content; a third editing operation instructing the generation of script content associated with the multiple media segments for sorting the multiple media segments; a fourth editing operation instructing the generation of text content associated with at least one media content; and a fifth editing operation instructing the addition of editing effects associated with at least one media content.
[0260] In this way, the embodiments of this disclosure can edit media content based on a variety of editing operations, thereby ensuring the video quality and presentation effect of the generated video content.
[0261] In some embodiments, presenting video clip information includes: presenting target media content in at least one type of media content; and presenting at least one media segment cropped from the target media content in a target style.
[0262] In this way, embodiments of the present disclosure can present media segments cropped from media content in a highlighted style, so that users can quickly locate and understand the media segments, thereby improving the user experience.
[0263] In some embodiments, process 500 further includes: before providing at least one first video content generated based on multiple editing operations, electronic device 110, in response to completing a partial editing operation among the multiple editing operations, jumping to a second interactive interface; and, in the second interactive interface, presenting a preview result of at least one video draft corresponding to the partial editing operation.
[0264] As an example, the second interactive interface can be a video viewing interface, such as interface 200F shown in Figure 2F.
[0265] In this way, embodiments of the present disclosure can present a preview of the video draft after some editing operations are completed, so that users can understand the editing progress and editing effect in a timely manner, thereby improving the user experience.
[0266] In some embodiments, providing at least one first video content generated based on multiple editing operations includes: updating at least one video draft in a second interactive interface in response to completing a subsequent editing operation in the multiple editing operations, so as to present the generated at least one first video content.
[0267] In this way, the embodiments of this disclosure can update the processing progress of the video draft in a timely manner and present the generated video content in a timely manner, making it convenient for users to view the video content in a timely manner and improving the user interaction experience.
[0268] In some embodiments, process 500 further includes: the electronic device 110 presenting a viewing entry for creative information in a second interactive interface; and, in response to triggering the viewing entry, presenting creative information, which includes material analysis information and video editing information.
[0269] In this way, embodiments of this disclosure enable users to view the corresponding creation information for generated video content, facilitating access to and understanding of material analysis information and video editing information associated with the video content, thereby enhancing the user experience.
[0270] Example devices and equipment
[0271] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 6 shows a schematic structural block diagram of an example apparatus 600 for video generation according to certain embodiments of this disclosure. Apparatus 600 may be implemented as or included in electronic device 110. The various modules / components in apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.
[0272] As shown in Figure 6, the device 600 includes: a request acquisition module 610, a first information presentation module 620, a second information presentation module 630, and a first video viewing module 640. The request acquisition module 610 is configured to acquire a video generation request associated with at least one piece of media content; the first information presentation module 620 is configured to present material analysis information generated based on at least one piece of media content; the second information presentation module 630 is configured to present video editing information indicating multiple editing operations determined based on the material analysis information; and the first video viewing module 640 is configured to provide at least one piece of first video content generated based on the multiple editing operations.
[0273] In some embodiments, obtaining a video generation request includes: obtaining at least one piece of media content via a first interactive interface; obtaining generation configuration information via at least one input control in the first interactive interface; and obtaining a video generation request based on at least one piece of media content and the generation configuration information.
[0274] In some embodiments, obtaining generation configuration information via at least one input control in a first interactive interface includes at least one of the following: obtaining prompt information input by the user via the first input control; determining whether to enable the generation tool associated with the model via the second input control; and determining at least one parameter of the video content to be generated via the third control.
[0275] In some embodiments, the generation tool includes a first generation tool and / or a second generation tool. The first generation tool is configured to generate subtitle content using a model; the second generation tool is configured to generate speech content using a model.
[0276] In some embodiments, presenting video clip information includes: presenting video clip information in response to a video generation request meeting preset conditions, wherein the preset conditions include: the total duration of at least one media content being greater than a preset duration; or, the video generation request instructing the activation of a generation tool associated with the model.
[0277] In some embodiments, the device 600 further includes a second video viewing module configured to provide at least one second video content generated based on a video template and at least one piece of media content in response to a video generation request not indicating the activation of a generation tool, wherein the video template is determined based on at least one piece of media content.
[0278] In some embodiments, the multiple editing operations include at least one of the following editing operations: a first editing operation instructing the cutting of multiple media segments from at least one media content; a second editing operation instructing the determination of music content associated with at least one media content; a third editing operation instructing the generation of script content associated with the multiple media segments for sorting the multiple media segments; a fourth editing operation instructing the generation of text content associated with at least one media content; and a fifth editing operation instructing the addition of editing effects associated with at least one media content.
[0279] In some embodiments, presenting video clip information includes: presenting target media content in at least one type of media content; and presenting at least one media segment cropped from the target media content in a target style.
[0280] In some embodiments, the device 600 further includes a draft preview module, which is configured to, before providing at least one first video content generated based on multiple editing operations, jump to a second interactive interface in response to the completion of a partial editing operation among the multiple editing operations; and, in the second interactive interface, present a preview result of at least one video draft corresponding to the partial editing operation.
[0281] In some embodiments, providing at least one first video content generated based on multiple editing operations includes: updating at least one video draft in a second interactive interface in response to completing a subsequent editing operation in the multiple editing operations, so as to present the generated at least one first video content.
[0282] In some embodiments, the device 600 further includes a creation information viewing module, which is configured to present a viewing entry for creation information in a second interactive interface; and to present creation information, including material analysis information and video editing information, in response to triggering the viewing entry.
[0283] In the apparatus 600 provided in the embodiments of this disclosure, the specific processing procedures of each module and the technical effects they bring can be referred to the relevant description of the example process 500 above, and will not be repeated here.
[0284] As shown in Figure 7, the electronic device 700 is in the form of a general-purpose electronic device. Components of the electronic device 700 may include, but are not limited to, at least one processor 710 or processing unit, memory 720, storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processor 710 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 720. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 700.
[0285] Electronic device 700 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 720 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 730 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 700.
[0286] Electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 7, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 720 may include computer program product 725 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
[0287] The communication unit 740 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 700 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.
[0288] Input device 750 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 760 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 700 can also communicate with one or more external devices (not shown) via communication unit 740 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 700, or with any device that enables electronic device 700 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).
[0289] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
[0290] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0291] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0292] Computer-readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0293] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0294] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A video generation method, comprising: Obtain a video generation request, wherein the video generation request is associated with at least one piece of media content; Presenting material analysis information, which is related to the at least one piece of media content; Presenting video editing information, which indicates multiple editing operations, and these multiple editing operations are related to the material analysis information; and Provide at least one first video content, which is obtained based on the multiple editing operations.
2. The method according to claim 1, wherein, The video generation request includes: The at least one piece of media content is obtained through the first interactive interface; Obtain the generation configuration information via at least one input control in the first interactive interface; and Based on the at least one piece of media content and the generation configuration information, the video generation request is obtained.
3. The method according to claim 2, wherein, Obtaining the generation configuration information via at least one input control in the first interactive interface includes at least one of the following: The prompt information entered by the user is obtained through the first input control; The second input control determines whether to enable the generation tool associated with the model; At least one parameter of the video content to be generated is determined via a third input control.
4. The method according to claim 3, wherein, The generation tool includes: The first generation tool is configured to generate subtitle content using a model; The second generation tool is configured to generate speech content using a model.
5. The method according to any one of claims 1 to 4, wherein, The presentation of video clip information includes: responding to the video generation request meeting preset conditions, presenting the video clip information, wherein the preset conditions include: The total duration of at least one of the media contents is greater than the preset duration; or The video generation request instructs the activation of the generation tool associated with the model.
6. The method according to claim 5, further comprising: In response to the video generation request not indicating that the generation tool is enabled, at least one second video content is provided, the at least one second video content being obtained based on a video template and the at least one media content, the video template being related to the at least one media content.
7. The method according to any one of claims 1 to 6, wherein, The multiple editing operations include at least one of the following: The first editing operation instructs the cutting of multiple media segments from the at least one type of media content; The second editing operation instructs the determination of music content associated with the at least one media content; The third editing operation instructs the generation of script content associated with the plurality of media segments for sorting the plurality of media segments; The fourth editing operation instructs the generation of text content associated with the at least one piece of media content; The fifth editing operation instructs the addition of editing effects associated with the at least one piece of media content.
8. The method according to claim 7, wherein, The presented video clip information includes: Presenting the target media content from the at least one of the media contents; and Present at least one media segment cropped from the target media content in the target style.
9. The method according to any one of claims 1 to 8, wherein, Prior to providing the at least one first video content, the method further includes: In response to the completion of a partial editing operation among the multiple editing operations, the user is redirected to a second interactive interface; and In the second interactive interface, a preview result of at least one video draft is presented, and the preview result is associated with the partial editing operation.
10. The method according to claim 9, wherein, The provision of the at least one first video content includes: In response to the completion of a subsequent editing operation among the multiple editing operations, the at least one video draft in the second interactive interface is updated to present the at least one first video content.
11. The method according to claim 9 or 10, further comprising: The second interactive interface presents an entry point for viewing creation information; as well as In response to the triggering of the viewing entry, creation information is presented, including the material analysis information and the video editing information.
12. An apparatus for video generation, comprising: The request acquisition module is configured to acquire a video generation request, which is associated with at least one piece of media content; The first information presentation module is configured to present material analysis information, which is related to the at least one piece of media content. The second information presentation module is configured to present video clip information, which indicates multiple editing operations and is related to the material analysis information. as well as The first video viewing module is configured to provide at least one first video content, which is obtained based on the multiple editing operations.
13. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 11 when executed by the at least one processor.
14. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 11.
15. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 11.
