Method and apparatus for generating video template, and device and storage medium

Abstract

Embodiments of the present invention relate to a method and apparatus for generating a video template, and a device and a storage medium. The method provided herein comprises: acquiring first input material and configuration information; on the basis of the first input material and the configuration information, determining first generation material for generating a video, wherein the first generation material is generated on the basis of the first input material and the configuration information; on the basis of the first input material and the first generation material, generating a first video editing result, wherein the first video editing result is used for displaying a video effect obtained by processing the first input material and the first generation material according to a specified editing operation; and on the basis of the video editing result, generating a video template, wherein the video template at least indicates the configuration information and the editing operation. In this way, according to the embodiments of the present invention, a video template can be published using inputted material and generated material and on the basis of the creative operation of a user, thereby helping share the creativity of the user, and enhancing interaction experience.

Description

Method, device, equipment and storage medium for generating video template

[0001] This application claims priority to the Chinese invention patent application entitled “Method, apparatus, device and storage medium for generating video templates” filed on February 29, 2024, with application number: 202410232975.0. The entire contents of this application are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for generating video templates. Background Art

[0003] With the development of computer technology, the Internet has become an important platform for people to exchange information. In the process of information exchange through the Internet, people expect to use more diverse creative video template types in the interaction process. Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for generating a video template is provided. The method comprises: obtaining a first input material and configuration information; determining a first generated material for generating a video based on the first input material and the configuration information, wherein the first generated material is generated based on the first input material and the configuration information; generating a first video editing result based on the first input material and the first generated material, wherein the first video editing result is used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation; and generating a video template based on the video editing result, wherein the video template at least indicates the configuration information and the editing operation.

[0005] In a second aspect of the present disclosure, a video generation method is provided. The method includes: determining a video template to be applied, the video template indicating at least configuration information and a specified editing operation; obtaining a second input material; and providing a second video editing result based on the video template and the second input material, the second video editing result being used to display a video effect obtained by processing the second input material and a second generated material according to the editing operation, the second generated material being generated based on the second input material and the configuration information.

[0006] In a third aspect of the present disclosure, a device for generating a video template is provided. The device includes: an information acquisition module configured to acquire a first input material and configuration information; a material determination module configured to determine a first generated material for generating a video based on the first input material and the configuration information, wherein the first generated material is generated based on the first input material and the configuration information; a video generation module configured to generate a first video editing result based on the first input material and the first generated material, wherein the first video editing result is used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation; and a template generation module configured to generate a video template based on the video editing result, wherein the video template at least indicates the configuration information and the editing operation.

[0007] In a fourth aspect of the present disclosure, a video generation device is provided. The device includes: a template determination module configured to determine a video template to be applied, the video template indicating at least configuration information and a specified editing operation; a material acquisition module configured to acquire a second input material; and a video providing module configured to provide a second video editing result based on the video template and the second input material, the second video editing result being used to display a video effect obtained by processing the second input material and a second generated material according to the editing operation, the second generated material being generated based on the second input material and the configuration information.

[0008] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect or the second aspect.

[0009] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein computer-executable instructions are stored on the computer-readable storage medium, and the computer-executable instructions can be executed by a processor to implement the method of the first aspect or the second aspect.

[0010] In a seventh aspect of the present disclosure, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions. When the computer-executable instructions are executed by a device, the device performs the method of the first aspect or the second aspect.

[0011] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0013] FIG1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure may be implemented;

[0014] 2A to 2E illustrate example interfaces according to some embodiments of the present disclosure;

[0015] FIG3 shows a flowchart of an example process of generating a video template according to some embodiments of the present disclosure;

[0016] FIG4 illustrates a flow chart of an example video generation process according to some embodiments of the present disclosure;

[0017] FIG5A shows a schematic structural block diagram of an example apparatus for generating a video template according to some embodiments of the present disclosure;

[0018] FIG5B shows a schematic structural block diagram of an example video generating apparatus according to some embodiments of the present disclosure; and

[0019] FIG6 illustrates a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0020] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0021] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0022] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0023] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0024] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.

[0025] In the video production process, video templates can help people spread video ideas and improve the efficiency of video production. According to traditional solutions, video templates are usually created by professional designers and have high requirements on the user's design level, which makes it difficult for users to effectively share their ideas.

[0026] The embodiments of the present disclosure propose a scheme for generating a video template. According to the scheme, a first input material and configuration information can be obtained; based on the first input material and the configuration information, a first generated material for generating a video is determined, the first generated material being generated based on the first input material and the configuration information; based on the first input material and the first generated material, a first video editing result is generated, the first video editing result being used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation; and based on the video editing result, a video template is generated, the video template indicating at least the configuration information and the editing operation.

[0027] In this way, the embodiments of the present disclosure can publish video templates based on the user's creative operations, using input materials and generated materials, thereby helping to share the user's creativity and improve the interactive experience.

[0028] Various example implementations of this solution are described in detail below with reference to the accompanying drawings.

[0029] Sample Environment

[0030] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the example environment 100 may include an electronic device 110 .

[0031] In this example environment 100, electronic device 110 may run an application 120 that supports interface interaction. Application 120 may be any suitable type of application for interface interaction, examples of which may include, but are not limited to, video applications, social applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0032] In the environment 100 of FIG. 1 , if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120 .

[0033] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0034] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. For example, the server 130 may include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 may provide background services for the application 120 that supports virtual scenes in the electronic device 110.

[0035] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0036] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0037] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0038] Example Interaction

[0039] The following will describe a process of generating a video template according to an example of an embodiment of the present disclosure with reference to the accompanying drawings.

[0040] 2A to 2E illustrate example interfaces 200A to 200E according to some embodiments of the present disclosure. The interfaces 200A to 200E may be provided by the electronic device 110 shown in FIG. 1 .

[0041] Figure 2A illustrates an example image selection interface according to some embodiments of the present disclosure. As shown in Figure 2A , a user can select an image from an album as the first input material (e.g., image 210). This first input material can also be an image currently being taken by the user. This disclosure is not intended to limit the specific form of image selection.

[0042] In some embodiments, the input material may include other suitable types of materials besides static image materials, such as expression materials, video materials, animated image materials, etc. For the convenience of description, the following describes the generation process of the video template using image materials as a basis.

[0043] Further, after receiving a selection of the image 210, the electronic device 110 may present an interface 200B as shown in Figure 2B. As shown in Figure 2B, the interface 200B may include one or more controls for obtaining configuration information 220 about the process of material generation.

[0044] In some embodiments, as shown in Figure 2B, configuration information 220 may indicate the style of the image to be generated. For example, control 221 may not specify a specific image style, and control 222 may indicate that the style of the image to be generated is "Style 1".

[0045] Furthermore, the interface 200B may include a control 224 for obtaining a guide word, which may be used to guide the process of generating the material. For example, the guide word may be provided to a material generation model to process the input material according to the guide word and generate the corresponding generated material.

[0046] In some examples, the interface 200B may further include a control 226 for obtaining control parameters associated with the material generation process. Such a control 226 may be used to indicate intensity information, for example, where different intensity information may indicate the degree of divergence of the generated material.

[0047] In some embodiments, the electronic device 110 may also acquire other types of configuration information in addition to the above-described configuration information such as style information, guide words, control parameters, etc. For example, the electronic device 110 may also support the user to specify a model for generating material.

[0048] Alternatively, the configuration information may also include, for example, preset configuration items without requiring user input or specification.

[0049] Continuing with reference to Figures 2B and 2C, electronic device 110 may provide generated material 230 generated based on the acquired configuration information 220. In some embodiments, such generated material 230 may be generated by an appropriate material generation model, such as an image-to-image model. Such configuration information 220 and input material 210 may be provided to the material generation model to generate corresponding generated material.

[0050] In some examples, as shown in FIG. 2C , the electronic device 110 may provide a single generated material 230 and may support the user to further adjust configuration information (eg, change the style, modify the guide words, adjust the intensity information, etc.) to obtain new generated material.

[0051] In other embodiments, the electronic device 110 may also provide multiple media materials 230 for the user to select. For example, the electronic device 110 may provide the user with multiple pictures generated based on the configuration information and the input picture, and the user may select a specific picture as the first generated material.

[0052] Furthermore, the electronic device 110 may also provide a video conversion entry 232 in the interface 200C to support the generation of a video editing result based on the input material 210 and the generated material 230. Specifically, after receiving a selection of the video conversion entry 232, the electronic device 110 may display the interface 200D shown in FIG2D.

[0053] 2D , in the interface 200D, the electronic device 110 may provide a video editing result 243 generated based on the input material 210 and the generated material 230. Such a video editing result 243 may be a video file or a video editing draft.

[0054] In some embodiments, the video editing result 243 is used to display the video effect obtained by processing the input material 210 and the generated material 230 according to the specified editing operation. As will be described in detail below, such editing operations can be determined based on user operations or can include preset editing operations.

[0055] In some embodiments, the video editing result 243 may be generated based on preset video generation information, which may include, but is not limited to, video transition effects, background music, and screen effects.

[0056] In some examples, the video editing result 243 may include, for example, a transition between the input material 210 and the generated material 230. For example, the first portion of the video editing result 243 may be the input material 210, and the second portion may be the generated material 230, with a preset transition effect applied between the two portions.

[0057] In some embodiments, the electronic device 110 may receive a user's preset operation on the video editing result 243 to generate a video template corresponding to the video editing result 243. Specifically, for example, the electronic device 110 may receive a user's selection of a generation entry 248 and may generate a video template accordingly.

[0058] Such a video template can support the current user or any other appropriate user to use the video template to generate a video with a corresponding style. In some embodiments, such a video template can indicate configuration information 220 about the generation process of the generated material 230. Such configuration information 220 may include but is not limited to the guide words, models, control parameters, etc. described above.

[0059] By indicating such configuration information 220 in the video template, embodiments of the present disclosure can support the user to generate corresponding materials by inputting corresponding materials for a video editing result corresponding to the video template.

[0060] In some embodiments, the video template may further indicate an editing operation corresponding to the video editing result 243. Such editing operations may be used, for example, to set the video transition effects, background music, screen effects, and the like described above.

[0061] In this way, when a user uses the video template, they only need to select the corresponding input material. Accordingly, the corresponding electronic device can generate generated material corresponding to the input material based on the configuration information indicated in the video template. For example, the model indicated by the configuration information can be called and the input material can be processed according to the guide words to generate the corresponding generated material. Furthermore, the input material and the generated material can be combined based on the video generation information indicated in the video template to generate the final video editing result.

[0062] 2D , the embodiment of the present disclosure may further indicate the user's modification of the video generation information. Specifically, the electronic device 110 may receive at least one editing operation on the video 243 by the user.

[0063] As an example, the electronic device 110 may present a set of candidate transition effects in the interface, such as transition effect 242 and transition effect 244. Furthermore, the electronic device 110 may receive a user's selection of transition effect 244 to set the transition effect to be applied to the generated material 230 and the input material 210 in the video editing result 243. For example, transition effect 242 may correspond to an empty transition effect.

[0064] As another example, the electronic device 110 may modify or select music content associated with the video editing result 243 , such as background music, via the control 246 .

[0065] Additionally, the electronic device 110 may also support the user, for example, to add additional media materials to the video editing result 243 through the interface 200D. Such media materials may include, but are not limited to, text stickers, emoticon stickers, and the like.

[0066] Accordingly, in the case where the user edits the video generation information, the generated video template may indicate the edited video generation information, such as the transition effects, background music, and media materials added by the user specified by the user.

[0067] In some embodiments, the electronic device 110 may also support downloading, sharing, or publishing the video template. For example, upon receiving a user's request to publish a generated video template, the electronic device 110 may present a publishing interface 200E as shown in FIG2E . As shown in FIG2E , the electronic device 110 may publish interface 200E to obtain publishing information for the video template.

[0068] As shown, such publishing information may include a text identifier 250 of the video template (eg, a title), a summary 252 of the video template (eg, an introduction), and an image identifier 254 of the video template (eg, a cover).

[0069] Additionally, the release information may also include the release scope 257 of the video template, such as the region in which it is released. Alternatively, the release information may also indicate the editing permissions of other users for the video template. For example, configuration item 256 may indicate whether the guide words indicated in the video template are allowed to be modified.

[0070] In some embodiments, after receiving a selection for the publishing entry 259 , the electronic device 110 may publish the video template corresponding to the video editing result 243 , for example, to support other users in acquiring and using the video template.

[0071] In some embodiments, the electronic device 110 may further support the user to share the video template with a specific user. For example, the electronic device 110 may support sharing the video template with a friend by sending a corresponding link.

[0072] In some embodiments, to improve the stylistic consistency of generated materials obtained by other users applying the video template, the video template may also, for example, indicate descriptive information regarding the input material 210 and / or generated material 230 used by the publisher of the video template. For purposes of organization, such descriptive information may include the files themselves of the input material 210 and / or generated material 230. Alternatively, such descriptive information may include corresponding text descriptions, such as a stylistic description.

[0073] In one example, the video template may include input material 210 and generated material 230 , and the input material 210 and generated material 230 may be provided together with configuration information 220 to a model for generating material to guide the model to generate new material with reference to the input material 210 and generated material 230 .

[0074] In this way, embodiments of the present disclosure can further improve the stylistic consistency between video editing results created based on video templates. Furthermore, as described above, the publisher may select a specific generated material from multiple candidate generated materials to create the video editing result. By indicating the descriptive information associated with the material in the video template, embodiments of the present disclosure can further enable the video template to more accurately convey the publisher's creativity.

[0075] As introduced above, the video template generated based on the process described above can support any appropriate user to quickly create corresponding video editing results by inputting materials.

[0076] As an example, upon obtaining input material, the corresponding electronic device may generate corresponding generated material based on the input material and the configuration information indicated by the video template. Furthermore, the electronic device may process the input material and the corresponding generated material based on the editing operations indicated by the video template, thereby obtaining the corresponding video editing results. For example, corresponding transition effects, background music, and visual effects may be applied to the input material and the generated material, or corresponding media materials may be added.

[0077] In some embodiments, the electronic device may further support the user to modify the configuration information and / or video generation information indicated in the video template. For example, the electronic device may support the user to modify the guide words, model, or control parameters in the configuration information indicated by the video template to obtain the corresponding generated materials. As another example, the electronic device may support the user to modify the transition effects, background music, screen effects, added media materials, etc. in the video generation information indicated by the video template to generate the final video editing result.

[0078] In this way, the embodiments of the present disclosure can publish video templates based on the user's creative operations, using input materials and generated materials, thereby helping to share the user's creativity and improve the interactive experience.

[0079] Example Process

[0080] FIG3 shows a flowchart of an example process 300 for generating a video template according to some embodiments of the present disclosure. The process 300 may be implemented at the electronic device 110. The process 300 is described below with reference to FIG1.

[0081] As shown in the figure, in block 310 , the electronic device 110 obtains first input material and configuration information.

[0082] In block 320 , the electronic device 110 determines a first generated material for generating a video according to the first input material and the configuration information, where the first generated material is generated based on the first input material and the configuration information.

[0083] In box 330, the electronic device 110 generates a first video editing result based on the first input material and the first generated material, where the first video editing result is used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation.

[0084] In block 340 , the electronic device 110 generates a video template based on the video editing result, where the video template indicates at least configuration information and editing operations.

[0085] In some embodiments, the configuration information includes at least one of the following: a guide word for generating the first generated material; a model for generating the first generated material; and a control parameter associated with generating the first generated material.

[0086] In some embodiments, process 300 further includes: receiving at least one user operation; and determining an editing operation based on the at least one user operation.

[0087] In some embodiments, the editing operation includes at least one of the following: a first editing operation for setting the transition effects of the first generated material and the first input material in the first video editing result; a second editing operation for setting the music content associated with the first video editing result; and a third editing operation for adding additional media materials to the first video editing result.

[0088] In some embodiments, the video template indicates: a transition effect determined based on a first editing operation; music content determined based on a second editing operation; and additional media materials added based on a third editing operation.

[0089] In some embodiments, process 300 further includes: presenting a publishing interface for the video template; and publishing the video template based on the publishing information received via the publishing interface.

[0090] In some embodiments, the publishing information includes at least one of the following: an identifier of the video template; an overview of the video template; a publishing scope of the video template; and editing permissions of other users on the video template.

[0091] In some embodiments, the generated video template is shared with at least one user.

[0092] In some embodiments, determining the first generated material for generating the video includes: providing multiple media materials generated based on the first input material and configuration information; and determining the first generated material for generating the video based on a selection of the first generated material from the multiple media materials.

[0093] In some embodiments, the video template further includes description information about the first input material and / or the first generated material.

[0094] FIG4 shows a flow chart of an example process 400 for video generation according to some embodiments of the present disclosure. The process 400 may be implemented at the electronic device 110. The process 400 is described below with reference to FIG1.

[0095] As shown in FIG. 4 , at block 410 , the electronic device 110 determines a video template to be applied, where the video template at least indicates configuration information and a specified editing operation.

[0096] At block 420 , the electronic device 110 acquires second input material.

[0097] In box 430, the electronic device 110 provides a second video editing result based on the video template and the second input material. The second video editing result is used to display the video effect obtained by processing the second input material and the second generated material according to the editing operation. The second generated material is generated based on the second input material and the configuration information.

[0098] In some embodiments, the configuration information includes at least one of the following: a guide word for material generation; a model for material generation; and a control parameter associated with the material generation process.

[0099] In some embodiments, the video template also indicates a transition effect, and the second video editing result is generated by applying the transition effect to the second input material and the second generated material; or the video template also indicates music content, and the second video editing result includes the music content indicated by the video template.

[0100] In some embodiments, process 400 further includes adjusting a transition effect and / or music content associated with the second video editing result based on at least one user operation from the user.

[0101] In some embodiments, the configuration information corresponds to a material generation process that generates a first generated material based on a first input material.

[0102] In some embodiments, the video template further includes description information about the first input material and / or the first generated material.

[0103] In some embodiments, process 400 further includes: receiving a modification to the configuration information; and obtaining second generated material generated based on the second input material and the modified configuration information.

[0104] Example devices and equipment

[0105] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG5A shows a schematic structural block diagram of an exemplary apparatus 500A for generating a video template according to certain embodiments of the present disclosure. Apparatus 500A may be implemented as or included in electronic device 110. Each module / component in apparatus 500A may be implemented by hardware, software, firmware, or any combination thereof.

[0106] As shown in Figure 5A, the device 500A includes an information acquisition module 510, which is configured to acquire a first input material and configuration information; a material determination module 520, which is configured to determine a first generated material for generating a video based on the first input material and the configuration information, and the first generated material is generated based on the first input material and the configuration information; a video generation module 530, which is configured to generate a first video editing result based on the first input material and the first generated material, and the first video editing result is used to display the video effect obtained by processing the first input material and the first generated material according to a specified editing operation; and a template generation module 540, which is configured to generate a video template based on the video editing result, and the video template at least indicates the configuration information and the editing operation.

[0107] In some embodiments, the configuration information includes at least one of the following: a guide word for generating the first generated material; a model for generating the first generated material; and a control parameter associated with generating the first generated material.

[0108] In some embodiments, the apparatus 500A further includes a receiving module configured to receive at least one user operation; and determine an editing operation based on the at least one user operation.

[0109] In some embodiments, the editing operation includes at least one of the following: a first editing operation for setting the transition effects of the first generated material and the first input material in the first video editing result; a second editing operation for setting the music content associated with the first video editing result; and a third editing operation for adding additional media materials to the first video editing result.

[0110] In some embodiments, the video template indicates: a transition effect determined based on a first editing operation; music content determined based on a second editing operation; and additional media materials added based on a third editing operation.

[0111] In some embodiments, the apparatus 500A further comprises a publishing module configured to present a publishing interface for the video template; and publish the video template based on the publishing information received via the publishing interface.

[0112] In some embodiments, the publishing information includes at least one of the following: an identifier of the video template; an overview of the video template; a publishing scope of the video template; and editing permissions of other users on the video template.

[0113] In some embodiments, the generated video template is shared with at least one user.

[0114] In some embodiments, the material determination module 520 is further configured to: provide a plurality of media materials generated based on the first input material and configuration information; and determine a first generated material for generating a video based on a selection of a first generated material from the plurality of media materials.

[0115] In some embodiments, the video template further includes description information about the first input material and / or the first generated material.

[0116] 5B shows a schematic structural block diagram of an exemplary video generation apparatus 500B according to certain embodiments of the present disclosure. Apparatus 500B may be implemented as or included in electronic device 110. Each module / component in apparatus 500B may be implemented by hardware, software, firmware, or any combination thereof.

[0117] As shown in Figure 5B, the device 500B includes a template determination module 550, which is configured to determine a video template to be applied, and the video template at least indicates configuration information and a specified editing operation; a material acquisition module 560, which is configured to obtain a second input material; and a video providing module 570, which is configured to provide a second video editing result based on the video template and the second input material, and the second video editing result is used to display the video effect obtained by processing the second input material and the second generated material according to the editing operation, and the second generated material is generated based on the second input material and the configuration information.

[0118] In some embodiments, the configuration information includes at least one of the following: a guide word for material generation; a model for material generation; and a control parameter associated with the material generation process.

[0119] In some embodiments, the video template also indicates a transition effect, and the second video editing result is generated by applying the transition effect to the second input material and the second generated material; or the video template also indicates music content, and the second video editing result includes the music content indicated by the video template.

[0120] In some embodiments, the apparatus 500B further includes a first editing module configured to adjust the transition effects and / or music content associated with the second video editing result based on at least one user operation.

[0121] In some embodiments, the configuration information corresponds to a material generation process that generates a first generated material based on a first input material.

[0122] In some embodiments, the video template further includes description information about the first input material and / or the first generated material.

[0123] In some embodiments, the apparatus 500B further includes a second editing module configured to: receive a modification to the configuration information; and obtain a second generated material generated based on the second input material and the modified configuration information.

[0124] FIG6 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 600 shown in FIG6 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 600 shown in FIG6 can be used to implement the electronic device 110 of FIG1 .

[0125] As shown in FIG6 , electronic device 600 is a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to, one or more processors or processors 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processor 610 may be a real or virtual processor and is capable of executing various processes according to programs stored in memory 620. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 600.

[0126] The electronic device 600 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 600.

[0127] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG6 , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0128] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0129] The input device 650 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 660 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 600, or with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0130] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0131] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0132] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0133] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0134] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0135] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating a video template, comprising: Obtaining first input material and configuration information; Determining, according to the first input material and the configuration information, a first generated material for generating a video, wherein the first generated material is generated based on the first input material and the configuration information; generating a first video editing result based on the first input material and the first generated material, wherein the first video editing result is used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation; as well as Based on the video editing result, a video template is generated, where the video template at least indicates the configuration information and the editing operation.

2. The method according to claim 1, wherein the configuration information includes at least one of the following: A guide word for generating the first generation material; A model for generating the first generated material; Control parameters associated with generating the first generated material.

3. The method according to claim 1, further comprising: Receive at least one user action; as well as The editing operation is determined based on the at least one user operation.

4. The method according to claim 1, wherein the editing operation comprises at least one of the following: A first editing operation is used to set a transition effect between the first generated material and the first input material in the first video editing result; A second editing operation is used to set music content associated with the first video editing result; The third editing operation is used to add additional media materials to the first video editing result.

5. The method of claim 4, wherein the video template indicates: The transition effect determined based on the first editing operation; the music content determined based on the second editing operation; The additional media material is added based on the third editing operation.

6. The method according to claim 1, further comprising: Presenting a publishing interface for the video template; as well as The video template is published based on the publishing information received via the publishing interface.

7. The method according to claim 6, wherein the published information includes at least one of the following: an identifier of the video template; An overview of the video template; The release scope of the video template; Other users' editing rights to the video template.

8. The method according to claim 1, comprising: The generated video template is shared with at least one user.

9. The method according to claim 1, wherein determining the first generation material for generating the video comprises: providing a plurality of media materials generated based on the first input material and the configuration information; as well as Based on the selection of the first generation material from the plurality of media materials, the first generation material for generating a video is determined. 10 . The method according to claim 1 , wherein the video template further comprises description information about the first input material and / or the first generated material.

11. A video generation method, comprising: Determining a video template to be applied, the video template indicating at least configuration information and a specified editing operation; Obtaining a second input material; as well as Based on the video template and the second input material, a second video editing result is provided. The second video editing result is used to display the video effect obtained by processing the second input material and the second generated material according to the editing operation. The second generated material is generated based on the second input material and the configuration information.

12. The method according to claim 11, wherein the configuration information comprises at least one of the following: Guide words used for material generation; Models for asset generation; Control parameters associated with the material generation process.

13. The method according to claim 11, wherein: The video template further indicates a transition effect, and the second video editing result is generated by applying the transition effect to the second input material and the second generated material; or The video template also indicates music content, and the second video editing result includes the music content indicated by the video template.

14. The method according to claim 13, further comprising: Based on at least one user operation, adjust the transition effect and / or the music content associated with the second video editing result. 15 . The method of claim 11 , wherein the configuration information corresponds to a material generation process that generates a first generated material based on a first input material. 16 . The method according to claim 15 , wherein the video template further comprises description information about the first input material and / or the first generated material.

17. The method according to claim 11, further comprising: receiving a modification to the configuration information; as well as The second generated material generated based on the second input material and the modified configuration information is acquired.

18. A device for generating a video template, comprising: An information acquisition module is configured to acquire first input material and configuration information; a material determination module configured to determine, according to the first input material and configuration information, a first generated material for generating a video, wherein the first generated material is generated based on the first input material and the configuration information; a video generation module configured to generate a first video editing result based on the first input material and the first generated material, wherein the first video editing result is used to display a video effect obtained by processing the first input material and the first generated material according to a specified editing operation; as well as The template generation module is configured to generate a video template based on the video editing result, where the video template at least indicates the configuration information and the editing operation.

19. A video generating device, comprising: a template determination module configured to determine a video template to be applied, wherein the video template at least indicates configuration information and a specified editing operation; A material acquisition module is configured to acquire a second input material; as well as The video providing module is configured to provide a second video editing result based on the video template and the second input material. The second video editing result is used to display the video effect obtained by processing the second input material and the second generated material according to the editing operation. The second generated material is generated based on the second input material and the configuration information.

20. An electronic device comprising: at least one processor; as well as At least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to any one of claims 1 to 10 or 11 to 17.

21. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions can be executed by a processor to implement the method according to any one of claims 1 to 10 or 11 to 17.

22. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method of any one of claims 1 to 10 or 11 to 17.

Images