Material editing method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a material editing method and device, electronic equipment, a storage medium and a program product, a video editing interface is displayed, a first material track is arranged in the video editing interface, and a first material is arranged in the first material track; in response to a first trigger operation for the video editing interface, a function module interface is displayed, a first function module is arranged in the function module interface, and the first function module is used for automatically editing the first material based on feature parameters representing an editing mode; and replacing the first material in the first material track with a second material, wherein the second material is a result obtained by automatically editing the first material by the first function module. The editing operation on the first material is triggered through the first function module arranged in the function module interface, automatic editing of the first material is completed by utilizing the characteristic parameters representing the editing mode, and the editing operation efficiency and the material editing effect are improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of Internet technologies, and in particular, to a method, an apparatus, an electronic device, a storage medium, and a program product for editing materials. Background Art

[0002] Currently, in video editing applications (APPs) or video editing platforms, the configuration, editing, combination, and other editing operations on materials are usually implemented in the form of a timeline plus a material track. Finally, the edited materials on the material track are used to render and generate the final video work.

[0003] Among them, editing the materials on the material track is one of the basic steps for editing materials. In the prior art, the process of editing materials is usually achieved by the user based on the observation of materials and editing experience. Therefore, there are problems of low editing operation efficiency and poor material editing effect during the editing process. Summary of the Invention

[0004] Embodiments of the present disclosure provide a method, an apparatus, an electronic device, a storage medium, and a program product for editing materials to overcome the problems of low editing operation efficiency and poor material editing effect.

[0005] In a first aspect, embodiments of the present disclosure provide a method for editing materials, including:

[0006] Display a video editing interface, where a first material track is set in the video editing interface, and a first material is set in the first material track;

[0007] In response to a first trigger operation on the video editing interface, display a function module interface, where a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on feature parameters representing an editing method;

[0008] In response to a second trigger operation on the first function module, replace the first material in the first material track with a second material, where the second material is the result of automatically editing the first material by the first function module.

[0009] In a second aspect, embodiments of the present disclosure provide a device for editing materials, including:

[0010] A display module, configured to display a video editing interface, where a first material track is set in the video editing interface, and a first material is set in the first material track;

[0011] The first functional module is configured to display a functional module interface in response to a first trigger operation on the video editing interface. A first functional module is provided in the functional module interface, and the first functional module is configured to automatically edit the first material based on feature parameters representing the editing method.

[0012] The second functional module replaces the first material in the first material track with a second material in response to a second trigger operation on the first functional module, where the second material is the result of automatically editing the first material by the first functional module.

[0013] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0014] The memory stores computer-executable instructions;

[0015] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the video editing method as described in the first aspect and various possible designs of the first aspect above.

[0016] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When the processor executes the computer-executable instructions, the video editing method as described in the first aspect and various possible designs of the first aspect above is implemented.

[0017] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, where when the computer program is executed by a processor, the video editing method as described in the first aspect and various possible designs of the first aspect above is implemented.

[0018] The material editing method, device, electronic device, storage medium, and program product provided in this embodiment display a video editing interface, in which a first material track is set, and a first material is set in the first material track; in response to a first trigger operation on the video editing interface, a function module interface is displayed, where a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on characteristic parameters representing the editing method; in response to a second trigger operation on the first function module, the first material in the first material track is replaced with a second material, and the second material is the result of automatically editing the first material by the first function module. By using the first function module set in the function module interface to trigger the editing operation of the first material, this method can complete the automatic editing of the first material by using the characteristic parameters representing the editing method, and automatically drop the result of the automatic editing onto the track, completing the efficient editing of the first material in the first material track, and improving the editing operation efficiency and the material editing effect. Description of the Drawings

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present disclosure. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 It is an application scenario diagram of the material editing method provided in the embodiments of the present disclosure;

[0021] Figure 2 It is a flowchart of the material editing method provided in the embodiments of the present disclosure Figure 1 ;

[0022] Figure 3 It is a schematic diagram of the process of automatically trimming the first material provided in the embodiments of the present disclosure;

[0023] Figure 4 It is Figure 2 a flowchart of the specific implementation manner of step S103 in the shown embodiment;

[0024] Figure 5 It is a schematic diagram of the process of replacing the first material in the first material track with the second material provided in the embodiments of the present disclosure;

[0025] Figure 6 It is a flowchart of the material editing method provided in the embodiments of the present disclosure Figure 2 ;

[0026] Figure 7 A schematic diagram of a function module interface provided by an embodiment of the present disclosure;

[0027] Figure 8 A flowchart of a specific implementation manner of inserting additional materials generated by the second function module into the second material track of the video editing interface in step S204;

[0028] Figure 9 A schematic diagram of the execution process of an automatic processing link provided by an embodiment of the present disclosure;

[0029] Figure 10 For Figure 8 A flowchart of a specific implementation manner of step S2042 in the illustrated embodiment;

[0030] Figure 11 A structural block diagram of a material editing device provided by an embodiment of the present disclosure;

[0031] Figure 12 A structural schematic diagram of an electronic device provided by an embodiment of the present disclosure;

[0032] Figure 13 A hardware structural schematic diagram of the electronic device provided by an embodiment of the present disclosure. Specific implementation manners

[0033] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Apparently, the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present disclosure without creative efforts shall fall within the protection scope of the present disclosure.

[0034] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards of relevant countries and regions, and corresponding operation entrances are provided for users to select authorization or rejection.

[0035] The application scenarios of the embodiments of the present disclosure are explained below:

[0036] The material editing method provided by the embodiments of the present disclosure can be applied to an application program (APP, Application) with video editing functions, such as video editing applications, short video applications, etc. More specifically, it can be applied to an application scenario where materials on a material track are processed in a video editing application. The execution entity of this embodiment can be a terminal device running the above-mentioned application program with video editing functions, or a server deploying the server corresponding to the above application program, or other electronic devices with similar functions. Among them, when the execution entity is a terminal device, the terminal device executes the method provided by this embodiment by running the above application program; when the execution entity is a server, the server side of the above application program with video editing functions can run partially or entirely on the server and execute the method provided by this embodiment on the server side, while the terminal device runs the client of the application program. Based on the server-client communication between the server and the terminal device, the terminal device can obtain the execution result of the method provided by this embodiment and display it as needed.

[0037] Among them, in some embodiments, the terminal device or the server can implement the material editing method provided by the embodiments of the present disclosure by running various computer-executable instructions or computer programs. For example, the computer-executable instructions can be program-level commands, machine instructions, or software instructions. The computer program can be a native program or software module in the operating system; it can be a local application program, that is, a program that needs to be installed in the operating system to run, or a small program embedded in any APP, that is, a program running based on the browser environment. In summary, the above computer-executable instructions can be in any form of instructions, and the above computer programs can be in any form of application programs, modules, or plugins, and the specific implementation form can be configured according to needs. Further, in the process of implementing the material editing method provided by the embodiments of the present disclosure, the terminal device can execute the method by running the computer-executable instructions or computer programs set locally, or by calling the computer-executable instructions or computer programs set in an external server. In some embodiments, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud storage, cloud communication, cloud databases, cloud computing, cloud functions, network services, middleware services, domain name services, security services, content delivery network (Content Delivery Network, CDN), and big data and artificial intelligence platforms. Among them, the cloud service can be an interactive processing service for the terminal device to call.

[0038] Figure 1A scenario diagram for the material editing method provided by an embodiment of the present disclosure. Refer to Figure 1 As shown in

[0039] For example, taking a terminal device as an example, a target application with an editing function runs in the terminal device. The interaction interface of the target application includes a video editing interface. A material track is set in the video editing interface. The user can configure materials into the material track to construct a video. The materials include, for example: video clips, pictures, audio clips, text, etc. Different materials are configured in corresponding material tracks. For example, as shown in the figure, in material track #1, video clip video_1 is configured, and in material track #2, audio music_1 is configured, and so on. At the same time, in the video editing interface, a preview window is also set. Through this preview window, the combined effect of the materials configured in each current material track can be displayed. The user can also adjust the positional relationship between different materials through this preview window. Among them, the materials in each material track are played based on the same time axis. Therefore, at the same moment, the content (including images, audio, text, etc.) of the materials on all material tracks will be rendered into the same video frame (and the audio frame corresponding to the video frame is generated), and played through the preview window, so that the user can preview the effect of the above video editing.

[0040] The embodiment of the present disclosure provides a material editing method to solve the above problems.

[0041] Refer to Figure 2 , Figure 2 The flow diagram of the material editing method provided by the embodiment of the present disclosure Figure 1。The method of this embodiment can be applied to a terminal device or a server. Among them, for the case where the terminal device executes the method provided in this embodiment, in one possible implementation, the terminal device can implement the material editing method provided in this embodiment by executing the program code deployed locally. In another possible implementation, the server can be used to deploy the functional service implemented based on the material editing method provided in this embodiment, and the terminal device can access the above server and call the corresponding functional service to implement the material editing method provided in this embodiment. Exemplarily, the material editing method provided in this embodiment includes:

[0042] Step S101: Display a video editing interface, in which a first material track is set, and a first material is set in the first material track.

[0043] Step S102: In response to a first trigger operation on the video editing interface, display a function module interface, where a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on the feature parameters representing the editing method.

[0044] Step S103: In response to a second trigger operation on the first function module, replace the first material in the first material track with a second material, where the second material is the result of automatically editing the first material by the first function module.

[0045] Reference Figure 1 As shown in the schematic diagram of the application scenario, in this embodiment, the terminal device is used as the execution subject to introduce the provided material editing method. Exemplarily, the terminal device provides a video editing function to the user by running the target application program. After the target application program is started, the video editing interface is displayed on the home page, or in response to a preset operation, the video editing interface is displayed. A first material track is set in the video editing interface. The first material track is, for example, the first material track, that is, the main material track. A first material is set in the first material track. The first material is the basic material for generating the final output video, for example, a video segment or a static picture. The user can configure other materials in other material tracks in the video editing interface to achieve the purpose of adding additional picture content to the picture of the first material, such as adding text, stickers, highlight effects, and corresponding audio to the video picture (the first material).

[0046] After that, in response to a first trigger operation on the video editing interface, a function module interface can be further displayed on the basis of the video editing interface. In a possible implementation manner, a trigger control corresponding to the function module interface is set in the video editing interface. The user can display the function module interface by clicking on the trigger control or display the function module interface based on other methods. Among them, a first function module is set in the function module interface. The first function module is a function module for automatically trimming the first material. After the first function module is triggered in response to a second trigger operation on the first function module, the terminal device can call a local or cloud algorithm to automatically edit the first material based on preset feature parameters or feature parameters input by the user means to obtain a second material, and the second material is the result of automatically editing the first material. After that, the terminal device can jump back to the video editing interface from the function module interface in a manual trigger or automatic trigger manner. At this time, the first material in the first material track in the video editing interface has been replaced by the above-mentioned second material, that is, the second material is successfully placed on the track, thus realizing the automatic trimming of the first material.

[0047] Figure 3 Schematic diagram of a process for automatically trimming the first material provided by an embodiment of the present disclosure, as Figure 3As shown in the figure, first, on the first material track Track_1 in the video editing interface, there is a first material video_1, which is, for example, a video clip. At the same time, at the bottom of the video editing interface, there is an entry control for the function module interface (shown as "AI Assistant" in the figure). After the user performs a first trigger operation on the entry control, the function module interface is displayed. There are multiple function modules in the function module interface, including a first function module mod_1, which can also be called a quick editing module or a rough editing module, and can be used to quickly and automatically edit the first material video_1 in the first material track Track_1. At the same time, optionally, in the function module interface, a guidance window can also be set, and guidance information such as the usage method and function introduction of the function modules in the function module interface is played or displayed in the guidance window. After that, in response to a second trigger operation on the first function module mod_1, in one possible implementation, the terminal device responds to the second trigger operation and obtains the default characteristic parameter para_0 representing the editing method to automatically edit the first material video_1, thereby directly obtaining the editing result, that is, the second material video_2; in another possible implementation, the terminal device responds to the second trigger operation on the first function module mod_1 and displays the setting interface of the first function module mod_1, which is used to configure the characteristic parameters of the corresponding function module. Exemplarily, there are a first type of parameter and a second type of parameter in the setting interface. Among them, the first type of parameter is a text parameter input by the user, and the second type of parameter is a preset parameter selected from multiple preset selection parameters (shown as option_1, option_2, option_3, option_4 in the figure). After that, the user further performs a first input operation on the setting interface, inputs the above first type of parameter and the second type of parameter, and clicks the "Generate" control, so that the terminal device obtains the target characteristic parameter para_1, and then based on the target characteristic parameter para_1, automatically edits the first material video_1 to obtain the editing result, that is, the second material video_3. Finally, for the above two methods, the terminal device will replace the first material video_1 in the first material track with the second material video_2 or video_3 obtained in the above steps, thereby completing the automatic trimming of the first material video_1.

[0048] Furthermore, as Figure 4 shown, the specific implementation manner of step S103 includes:

[0049] Step S1031: In response to a second trigger operation on the first function module, display the setting interface of the first function module, and the setting interface is used to configure the characteristic parameters of the corresponding function module;

[0050] Step S1032: In response to a first input operation on the setting interface, obtain target feature parameters, and based on the target feature parameters, call a multi-modal model to process the first material, and determine the corresponding target editing method;

[0051] Step S1033: Edit the first material based on the target editing method to generate a second material;

[0052] Step S1034: Replace the first material in the first material track with the second material.

[0053] Exemplarily, in combination with Figure 3 the schematic diagram of the process of automatically trimming the first material shown, after obtaining the feature parameters, in one possible implementation, a multi-modal model is called to process the first material based on the feature parameters, so as to realize the automatic editing of the first material. Among them, the multi-modal model, also known as the multi-modal large model, is a model obtained by jointly training multi-modal information such as text, images, videos, and audio. Through the multi-modal model, the purpose of generating audio and video based on text and characters can be achieved. The implementation principle and training method of the multi-modal large model will not be elaborated here. In this embodiment, when the target feature parameters of the means configuration are obtained by responding to the first input operation of the user, the target feature parameters can be descriptive text for describing the editing method, or an identifier that can represent the editing method. Correspondingly, the first input operation can be a text input operation, and the first input operation can also be an operation of clicking on a preset parameter control, where the preset parameter control is used to indicate the corresponding editing method. For example, when the first input operation is an operation of clicking on the parameter control P1, the terminal device obtains the target feature parameters corresponding to the parameter control P1. More specifically, the feature parameters are, for example, parameters indicating the video theme, such as including Vlog, speech, Q&A, etc. When the content of the feature parameters is "Vlog, speech, Q&A", the multi-modal model can edit the first media based on the above feature parameters with the target editing method that matches the video theme represented by the feature parameters, so as to generate a second video that matches the video theme. In another possible implementation, the feature parameters are, for example, an identifier or name representing the lens switching method, such as including: chronological order, narrative order, form order, montage order, etc. When the content of the feature parameters is "chronological order, narrative order, form order, montage order", the multi-modal model can edit the first media based on the above feature parameters with the target editing method that matches the lens switching method represented by the feature parameters, so as to generate a second video that matches the lens switching method.

[0054] Further, after generating the second material in the above steps, that is, after step S1033, in this embodiment, it further includes:

[0055] Step S103A: Display a preview interface, which is used to display the second material and the target feature parameters.

[0056] Step S103B: In response to a modification operation on the target feature parameters, update the second material and display the updated second material in the preview interface.

[0057] Exemplarily, after generating the second material, the target application can also jump to the preview interface, which is used to display the preview image of the second material generated based on the previous steps, and the target feature parameters for generating the second material. Based on the previous introduction, the target feature parameters can be used to characterize information such as the video theme and the lens switching method. In addition, the target feature parameters can also include information such as the video duration and the number of transitions. On this basis, the user can further adjust the target feature parameters in the preview interface through a modification operation, such as adjusting the video duration, the number of transitions, etc. (of the second material) of the target feature parameters. After that, the terminal device will regenerate the second material based on the updated target feature parameters, that is, update the second material, and directly display the update result in the preview interface. Thus, the user can directly modify the target feature parameters without returning to the setting interface, and display the updated second material in the preview interface, thereby improving the modification interaction efficiency for the second material.

[0058] Correspondingly, the specific implementation manner of step S1034 includes:

[0059] In response to a save operation on the preview interface, replace the first material in the first material track with the second material.

[0060] Exemplarily, in the case of displaying the preview interface, the confirmation of the second material can be achieved by responding to a save operation on the preview interface, and then jump back to the video editing interface, and replace the first material in the first material track with the second material.

[0061] Figure 5 It is a schematic diagram of the process of replacing the first material in the first material track with the second material provided by an embodiment of the present disclosure, as Figure 5As shown, the material video_1 is configured on the first material track Track_1 of the video editing interface. Starting from the video editing interface, in response to clicking the "AI Assistant" control, it first jumps to the function module interface, and then in response to the trigger of the first function module mod_1, it jumps to the setting interface to configure the target feature parameters. In the setting interface, there is a feature parameter Topic, and multiple theme options are preset, such as Vlog, speech, and Q&A shown in the figure. The user clicks on "Vlog" through an input operation, thereby determining the theme option "Vlog" as the target feature parameter. After that, after the terminal device generates the second material based on the target feature parameter, it jumps to the preview interface, and the preview image of the second material V1 is displayed in the preview display area of the preview interface, and the target feature parameter is displayed in the effect adjustment area. As shown in the figure, in the effect adjustment area of the preview interface, the selected theme option "Vlog" and other preset unselected theme options, such as "speech" and "Q&A", are displayed. After that, the user can perform a modification operation, such as clicking on the theme option "speech" and clicking the "Regenerate" control to regenerate the second material, that is, the second material V2. The updated second material V2 is immediately synchronously displayed in the preview display area of the preview interface for the user to observe. Finally, after the user clicks the "Save" control (confirmation operation) in the preview interface, it jumps to the video editing interface, and the first material video in the first material track Track_1 is replaced with the second material V2.

[0062] Optionally, in a possible implementation, the first input operation includes a parameter input operation and a confirmation operation that are executed sequentially. Among them, the parameter input operation is used to input or select the target feature parameter in the setting interface, and after the target feature parameter is input, the above target feature parameter is confirmed through the confirmation operation. After that, the terminal device will call the multimodal model to process the first material based on the target feature parameter. Before this step occurs, that is, after responding to the confirmation operation, the terminal device first jumps to the loading interface, which is used to display the process text, and the process text is used to represent the thinking process of the multimodal model to determine the target editing method based on the feature parameter, that is, the in-depth thinking process. So that the user can observe the processing process of the multimodal model, thereby improving the interaction efficiency between the user and the terminal device (the multimodal model called). Among them, the multimodal model is implemented based on the large language model. After training and configuration, it can display the thinking process during the problem-solving process. The specific implementation principle of this process will not be elaborated here. After displaying this loading interface, the terminal device continues to jump to the next processing step, that is, jump to the preview interface or return to the video editing interface.

[0063] In this embodiment, by displaying a video editing interface, a first material track is set in the video editing interface, and a first material is set in the first material track; in response to a first trigger operation on the video editing interface, a function module interface is displayed, wherein a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on the characteristic parameters representing the editing method; in response to a second trigger operation on the first function module, the first material in the first material track is replaced with a second material, and the second material is the result of automatically editing the first material by the first function module. By using the first function module set in the function module interface to trigger the editing operation of the first material, this method can complete the automatic editing of the first material by using the characteristic parameters representing the editing method, and automatically drop the result of the automatic editing onto the track, completing the efficient editing of the first material in the first material track, and improving the editing operation efficiency and the material editing effect.

[0064] Reference Figure 6 , Figure 6 is a flowchart of the material editing method provided by an embodiment of the present disclosure Figure 2 . This embodiment is based on Figure 2 the embodiment shown, and further processes the second function module. The material editing method includes:

[0065] Step S201: Display a video editing interface, in which a first material track is set, and a first material is set in the first material track.

[0066] Exemplarily, on this basis, optionally, at least one second material track may also be set in the video editing interface. The second material track is used to configure additional materials such as audio materials, text materials, and special effect materials. And in the initial state, no material is configured on the second material track, that is, the second material track is empty. In this embodiment, through subsequent steps, additional materials are generated and each additional material is dropped onto the corresponding track, that is, configured into the corresponding second material track.

[0067] Step S202: In response to a first trigger operation on the video editing interface, display a function module interface, wherein a first function module and at least one second function module are set in the function module interface. The first function module is used to automatically edit the first material based on the characteristic parameters representing the editing method, and the second function module is used to generate additional materials that match the material content of the first material.

[0068] Step S203: In response to a second trigger operation on the first function module, replace the first material in the first material track with a second material, and in response to a third trigger operation on the second function module, insert the additional material generated by the second function module into the second material track of the video editing interface.

[0069] Exemplarily, the process of replacing the first material in the first material track with the second material in response to the second trigger operation for the first functional module in the above steps has been introduced in the previous embodiments and will not be elaborated here. For reference, Figure 2 please refer to the relevant descriptions in the embodiments shown. In this embodiment, after the second functional module is displayed in the display functional module interface, corresponding functions can be executed in response to the trigger operation for the second functional module (i.e., the third trigger operation) to generate corresponding additional materials, such as music materials, text materials, sticker materials, special effect materials, etc., and the above-generated additional materials are tracked.

[0070] Among them, similar to the generation process of the second material, in one possible implementation, the second functional module corresponds to default characteristic parameters that have been pre-configured. When generating the corresponding additional material based on the second functional module, the additional material can be generated through the above default characteristic parameters; while in another possible implementation, the characteristic parameters corresponding to each second functional module are configured by the user. Specifically, in one possible implementation, in step S203, the specific implementation steps of inserting the additional material generated by the second functional module into the second material track of the video editing interface in response to the third trigger operation for the second functional module include:

[0071] Step S2031: Display the setting interface of the second functional module in response to the third trigger operation for the second functional module;

[0072] Step S2032: Generate additional characteristic parameters in response to the second input operation for the setting interface, and call a multimodal model to process the second material based on the additional characteristic parameters to generate an additional material;

[0073] Step S2033: Insert the additional material into the second material track corresponding to the material type in the video editing interface according to the material type of the additional material.

[0074] Through the above steps, autonomous configuration of the additional characteristic parameters for each second functional module can be achieved, thereby improving the control degree of the additional material during the process of generating the additional material and making it more in line with the user's needs. The specific content of the additional characteristic parameters is determined based on the second functional module. For example, for the second functional module used to generate music materials, the additional characteristic parameters may include various parameters for selecting music, etc., and will not be elaborated one by one here.

[0075] Figure 7 This is a schematic diagram of a functional module interface provided by an embodiment of the present disclosure, as Figure 7As shown, the first material track Track_1 of the video editing interface is configured with material video_1. Starting from the video editing interface, in response to clicking the "AI Assistant" control, it first jumps to the function module interface. In the function module interface, the first function module mod_1, the second function module mod_2, the second function module mod_3, and the second function module mod_4 are set. Among them, the first function module, which can also be called a fast editing module and a rough editing module, can be used to quickly and automatically edit the first material video_1 in the first material track Track_1 to generate the second material video_2. Its function has been introduced in the previous embodiment and will not be repeated here. The other three second function modules mod_2, mod_3, and mod_4 for generating additional materials are used to generate music materials, text materials, and special effects materials, respectively. More specifically, the second function module mod_2 is used to search for music matching the second material from the music library, the second function module mod_3 is used to generate text matching the content of the second material; the second function module mod_4 is used to generate highlight special effects matching the content of the second material. After that, after clicking the second function modules mod_2, mod_3, and mod_4, the corresponding additional materials are generated directly or indirectly, for example, the second function module mod_2 generates the music material music_1, the second function module mod_3 generates the text material text_1, and the second function module mod_4 generates the special effect material effe_1. After the generation, the above-mentioned attachment materials are respectively placed in the corresponding tracks, that is, after returning to the video editing interface, in addition to configuring the first material video_1 on the first material track Track_1, the music material music_1 is configured on the second material track Track_2, the text material text_1 is configured on the second material track Track_3, and the special effect material effe_1 is configured on the second material track Track_4.

[0076] Furthermore, the above-mentioned process of generating the second material and the attachment material and placing them on the track respectively can be realized by applying corresponding operations to the first function module and the second function module respectively. In a possible implementation manner, the purpose of inserting the attachment material generated by the second function module into the second material track of the video editing interface can be realized by only executing the second trigger operation in response to the first function module. That is, illustratively, this embodiment can also include:

[0077] Step S204: In response to the second trigger operation for the first functional module, the first material in the first material track is replaced with the second material, and the additional material generated by the second functional module is inserted into the second material track of the video editing interface.

[0078] Exemplarily, in a specific implementation, that is, when the terminal device receives a second trigger operation from the user for the first function module, the terminal device, through the target application, not only automatically edits the first material to generate the second material, but also further generates additional materials such as music, text, and special effects that match the second material based on the second material, and tracks them. Thus, a fully automatic editing effect of one-key editing, adding voiceovers and background music, and adding text special effects is achieved. Specifically, in one possible implementation, as Figure 8 shown, the specific implementation of inserting the additional materials generated by the second function module into the second material track of the video editing interface in step S204 includes:

[0079] Step S2041: In response to the second trigger operation for the first function module, generate the second material based on the first material.

[0080] Step S2042: Obtain a first processing link according to the target feature parameters and the second material, where the first processing link is used to represent the order of triggering the second function module.

[0081] Step S2043: Based on the first processing link, sequentially trigger at least one second function module to generate at least one additional material.

[0082] Step S2044: Replace the first material in the first material track with the second material, and insert at least one additional material into the corresponding second material track in the video editing interface.

[0083] Exemplarily, after generating the second material based on the first material, the terminal device obtains again the target feature parameters used when generating the first material, and through the information in the target feature parameters, such as the video theme, the lens switching method, etc., to match a processing link for the second material, that is, the first processing link, where the processing link is used to represent the order of triggering the second function module, that is, when the target feature parameters and / or the second material are different, it will cause the order of triggering the second function module, that is, the first processing link, to be different.

[0084] Figure 9 FIG. is a schematic diagram of the execution process of an automatic processing link provided by an embodiment of the present disclosure. The following will be combined with Figure 9 to introduce the above process. As Figure 9As shown, within the functional module interface, after the user triggers the first functional module mod_1, the terminal device generates the second material video_1 based on the first material and the target feature parameter para_1. Among them, the second material video_1 is a video clip, and the target feature parameter para_1 indicates that the theme of the second material is "news speech". After that, according to the above second material video_1 and the target feature parameter para_1, the first processing link chain_1 is determined, and the order of triggering the corresponding second functional module is: "subtitle generation module - music module". When triggering the corresponding second functional module based on the first processing link chain_1, first, the subtitle generation module generates the subtitle text_1 (additional material) for the second material video_1. After that, the music module processes the second material video_1 and the subtitle text_1, finds the music music_2 (additional material) that matches the above content from the database. Finally, the second material video_1, the subtitle text_1, and the music music_2 are respectively configured into the corresponding material tracks within the video editing interface. Thus, the effect of automatically executing the second functional modules mod_2 and mod_3 is achieved only by triggering the first functional module mod_1.

[0085] On the other hand, in combination with the above figure, after the second material video_2 is generated based on the first material and the target feature parameter para_2 (not shown in the figure), since the target feature parameter para_2 changes after the second material video_2 is generated, correspondingly, the determined first processing link also changes. For example, the first processing link chain_2 is generated. After that, based on the second functional modules represented by the first processing link chain_2 and the triggering order of each second functional module, the function is triggered to generate the corresponding additional materials. In this embodiment, the matching first processing link is determined through the second material and the target feature parameter. After that, based on one or more second functional modules represented by the first processing link and the triggering order between each second functional module, the triggering is performed in sequence, so that the generated additional materials can be more matched with the second material and the target feature parameter, making the generation order of the additional materials more reasonable, and avoiding the problem of content mismatch between multiple additional materials. For example, in the above Figure 9 shown embodiment, if the music material is generated first and then the subtitle material is generated, it may lead to the problem that the music style and rhythm of the music material may not match the news speech content represented by the subtitle material. Thus, the adaptability between each additional material is improved.

[0086] Furthermore, in a possible implementation manner, as Figure 10 shown, the specific implementation steps of step S2042 include:

[0087] Step S2042-1: Obtain a clip type according to the target feature parameter. The clip type is used to characterize the shot transition method, and the clip type includes one of the following: chronological order, narrative order, form order, and montage order.

[0088] Step S2042-2: Determine the trigger quantity, trigger order of the second functional module to be triggered, and the additional feature parameter corresponding to the second functional module to be triggered according to the clip type.

[0089] Step S2042-3: Obtain a first processing link according to the trigger quantity, trigger order of the second functional module to be triggered, and the additional feature parameter corresponding to the second functional module to be triggered.

[0090] Exemplarily, in the steps of this embodiment, the target feature parameter characterizes the clip type of the shot transition method for the first material, including chronological order, narrative order, form order, montage order, etc. When the clip type is different, the second material generated after automatic editing based on the first material will also be different. Correspondingly, the additional materials automatically recommended for the second material, and the generation order of each attachment material will also change accordingly. In a possible implementation manner, since the clip type is an enumerated data with a limited quantity, the trigger quantity, trigger order of the corresponding functional module, and the additional feature parameter corresponding to the functional module to be triggered can be mapped for each clip type through pre-configuration. Then, in the process of generating the first processing link, based on the above mapping relationship, determine the trigger quantity, trigger order of the second functional module corresponding to the clip type determined based on the target feature parameter, and the additional feature parameter corresponding to the second functional module to be triggered. Furthermore, based on the trigger quantity, trigger order of the second functional module to be triggered, and the additional feature parameter corresponding to the second functional module to be triggered, construct the first processing link. Further, in the process of executing the first processing link, the trigger quantity, trigger order of each second functional module to be triggered, and the additional feature parameter corresponding to the second functional module to be triggered are recorded in the first processing link. Therefore, it can be used to automatically trigger one or more second functional modules to generate the corresponding additional materials. In another possible implementation manner, a pre-trained processing model can also be used to map the clip type to the trigger quantity, trigger order of the corresponding functional module, and the additional feature parameter corresponding to the functional module to be triggered. The specific implementation principle and the training process of the processing model are not described in detail here.

[0091] In this embodiment, by obtaining the clip type according to the target feature parameter and then determining the first processing link based on the clip type, the triggering process of the second functional module indicated by the first processing link is such that the switching manner of the attachment materials generated by each second functional module with the second material is more matched, thereby improving the content adaptability among the second materials and improving the content rationality and visual effect of the video work rendered based on the second material and each additional material.

[0092] In this embodiment, the implementation manner of step S201 is the same as that of step S101 in the embodiment Figure 2 shown in the present disclosure, and will not be elaborated here one by one.

[0093] Corresponding to the material editing method in the above embodiment, Figure 11 is a structural block diagram of a material editing device provided by an embodiment of the present disclosure. The method introduced in the above embodiment can be executed by this material editing device, and this device can be implemented in a software and / or hardware manner, and this device can be integrated in an electronic device with a certain data processing function. Among them, the electronic device may include, but is not limited to, a mobile terminal with big data processing capabilities, and a fixed terminal with big data processing capabilities such as a desktop computer and a supercomputer.

[0094] For the sake of convenience of description, only the parts related to the embodiments of the present disclosure are shown. Referring to Figure 11 , the material editing device 3 includes:

[0095] A display module 31, configured to display a video editing interface, in which a first material track is set, and a first material is set in the first material track;

[0096] A first functional module 32, configured to display a functional module interface in response to a first triggering operation on the video editing interface. Among them, a first functional module is set in the functional module interface, and the first functional module is configured to automatically edit the first material based on the feature parameter representing the editing method;

[0097] A second functional module 33, in response to a second triggering operation on the first functional module, replaces the first material in the first material track with a second material, and the second material is the result of automatically editing the first material by the first functional module.

[0098] According to one or more embodiments of the present disclosure, the second functional module 33 is specifically configured to: in response to a second trigger operation on the first functional module, display a setting interface of the first functional module, where the setting interface is used to configure characteristic parameters of the corresponding functional module; in response to a first input operation on the setting interface, obtain target characteristic parameters, and based on the target characteristic parameters, call a multimodal model to process the first material, determine a corresponding target editing method, and edit the first material based on the target editing method to generate a second material; replace the first material in the first material track with the second material.

[0099] According to one or more embodiments of the present disclosure, the second functional module 33 is specifically configured to: display a preview interface, where the preview interface is used to display the second material and the target characteristic parameters; in response to a modification operation on the target characteristic parameters, update the second material and display the updated second material in the preview interface; when the second functional module 33 replaces the first material in the first material track with the second material, it is specifically configured to: in response to a save operation on the preview interface, replace the first material in the first material track with the second material.

[0100] According to one or more embodiments of the present disclosure, the first input operation includes a parameter input operation and a confirmation operation that are executed in sequence. The first functional module 32 is further configured to: after responding to the confirmation operation, display a loading interface, where the loading interface is used to display a process text, and the process text is used to represent the thinking process of the multimodal model for determining the target editing method based on the characteristic parameters.

[0101] According to one or more embodiments of the present disclosure, at least one second functional module is further provided in the functional module interface. The second functional module is used to generate additional materials that match the material content of the first material. After generating the second material, the second functional module 33 is further configured to: based on the target characteristic parameters and the second material, obtain a first processing link, where the first processing link is used to represent the order of triggering the second functional module; based on the first processing link, sequentially trigger at least one second functional module to generate at least one additional material; insert the at least one additional material into the corresponding second material track in the video editing interface respectively.

[0102] According to one or more embodiments of the present disclosure, when the second functional module 33 obtains the first processing link according to the target feature parameters and the second material, it is specifically configured to: obtain a clip type according to the target feature parameters, where the clip type is used to characterize the lens switching method, and the clip type includes one of the following: chronological order, narrative order, form order, montage order; determine the trigger quantity, trigger order of the second functional modules to be triggered, and additional feature parameters corresponding to the second functional modules to be triggered according to the clip type; obtain the first processing link according to the trigger quantity, trigger order of the second functional modules to be triggered, and additional feature parameters corresponding to the second functional modules to be triggered.

[0103] According to one or more embodiments of the present disclosure, at least one second functional module is further provided in the functional module interface, and the second functional module is used to generate additional materials that match the content of the second material; the second functional module 33 is further configured to: in response to a third trigger operation on the second functional module, insert the additional materials generated by the second functional module into the second material track of the video editing interface.

[0104] According to one or more embodiments of the present disclosure, when the second functional module 33 inserts the additional materials generated by the second functional module into the second material track of the video editing interface in response to a third trigger operation on the second functional module, it is specifically configured to: in response to a third trigger operation on the second functional module, display the setting interface of the second functional module; in response to a second input operation on the setting interface, generate additional feature parameters, and call a multimodal model to process the second material based on the additional feature parameters to generate additional materials; insert the additional materials into the second material track corresponding to the material type in the video editing interface according to the material type of the additional materials.

[0105] According to one or more embodiments of the present disclosure, the additional materials include one of the following: music materials, text materials, sticker materials, special effect materials.

[0106] Among them, the display module 31, the first functional module 32, and the second functional module 33 are connected in sequence. The material editing device 3 provided in this embodiment can execute the technical solutions of the above method embodiments, and its implementation principle and technical effects are similar, which will not be elaborated here in this embodiment.

[0107] Figure 12 The following is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure, as Figure 12 shown, the electronic device 4 includes:

[0108] a processor 41, and a memory 42 communicatively connected to the processor 41;

[0109] The memory 42 stores computer-executable instructions;

[0110] The processor 41 executes computer-executable instructions stored in the memory 42 to implement the video editing method in the embodiments as Figures 2 - 10 shown in the embodiments.

[0111] Optionally, the processor 41 and the memory 42 are connected through a bus 43.

[0112] For relevant descriptions, reference can be made to the relevant descriptions and effects corresponding to the steps in the Figures 2 - 10 corresponding embodiments for understanding, and no further elaboration will be made here.

[0113] Embodiments of the present disclosure provide a computer-readable storage medium storing computer-executable instructions, which are used to implement the video editing method provided in any one of the embodiments corresponding to the present disclosure when executed by a processor. Figures 2 - 10 Embodiments of the present disclosure provide a computer program product including a computer program, which implements the video editing method provided in any one of the embodiments corresponding to the present disclosure when executed by a processor.

[0114] Embodiments of the present disclosure provide an electronic device to implement the above embodiments. Figures 2 - 10 Referring to

[0115] FIG.

[0116] shows a schematic structural diagram of an electronic device 900 suitable for implementing embodiments of the present disclosure. The electronic device 900 can be a terminal device or a server. Among them, the terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs for short), tablet computers, portable media players (PMPs for short), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs and desktop computers. Figure 13 The electronic device shown is only an example and should not impose any limitations on the functions and usage scopes of the embodiments of the present disclosure. Figure 13 As

[0117] shown in Figure 13As shown, the electronic device 900 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 901, which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0118] Generally, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 13 an electronic device 900 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. Instead, more or fewer devices may be implemented or had.

[0119] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0120] It should be noted that the computer-readable medium described above in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0121] The above computer-readable medium may be included in the above electronic device; or it may exist separately and not be assembled into the electronic device.

[0122] The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the electronic device, the electronic device is caused to execute the method shown in the above embodiments.

[0123] Computer program code for performing the operations of this disclosure may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0124] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0125] The units or modules described in the embodiments of this disclosure may be implemented in software or in hardware. In this case, the name of the unit or module does not constitute a limitation to the unit itself in some situations.

[0126] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and so on.

[0127] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0128] In a first aspect, according to one or more embodiments of the present disclosure, there is provided a material editing method, including:

[0129] Displaying a video editing interface in which a first material track is provided, and a first material is provided in the first material track; in response to a first trigger operation on the video editing interface, displaying a function module interface, wherein a first function module is provided in the function module interface, and the first function module is configured to automatically edit the first material based on characteristic parameters representing a clipping method; in response to a second trigger operation on the first function module, replacing the first material in the first material track with a second material, where the second material is a result of automatically editing the first material by the first function module.

[0130] According to one or more embodiments of the present disclosure, in response to a second trigger operation on the first function module, replacing the first material in the first material track with a second material includes: in response to a second trigger operation on the first function module, displaying a setting interface of the first function module, where the setting interface is used to configure characteristic parameters of the corresponding function module; in response to a first input operation on the setting interface, obtaining target characteristic parameters, and based on the target characteristic parameters, invoking a multimodal model to process the first material, determining a corresponding target clipping method, and clipping the first material based on the target clipping method to generate a second material; replacing the first material in the first material track with the second material.

[0131] According to one or more embodiments of the present disclosure, after generating the second material, the method further includes: displaying a preview interface for presenting the second material and the target feature parameters; in response to a modification operation on the target feature parameters, updating the second material and displaying the updated second material on the preview interface; and replacing the first material in the first material track with the second material, including: in response to a save operation on the preview interface, replacing the first material in the first material track with the second material.

[0132] According to one or more embodiments of the present disclosure, the first input operation includes a parameter input operation and a confirmation operation executed in sequence. The method further includes: after responding to the confirmation operation, displaying a loading interface for displaying process text, where the process text is used to represent the thinking process of the multi-modal model for determining the target editing method based on the feature parameters.

[0133] According to one or more embodiments of the present disclosure, at least one second function module is further provided in the function module interface. The second function module is used to generate additional materials that match the content of the first material. After generating the second material, the method further includes: obtaining a first processing link based on the target feature parameters and the second material, where the first processing link is used to represent the order of triggering the second function module; based on the first processing link, sequentially triggering at least one second function module to generate at least one additional material; and inserting the at least one additional material into the corresponding second material track in the video editing interface.

[0134] According to one or more embodiments of the present disclosure, obtaining a first processing link based on the target feature parameters and the second material includes: obtaining a editing type according to the target feature parameters, where the editing type is used to represent the lens switching method, and the editing type includes one of the following: chronological order, narrative order, form order, montage order; determining the trigger number, trigger order of the second function module to be triggered, and the additional feature parameters corresponding to the second function module to be triggered according to the editing type; and obtaining a first processing link according to the trigger number, trigger order of the second function module to be triggered, and the additional feature parameters corresponding to the second function module to be triggered.

[0135] According to one or more embodiments of the present disclosure, at least one second function module is further provided in the function module interface. The second function module is used to generate additional materials that match the content of the second material; the method further includes: in response to a third trigger operation on the second function module, inserting the additional material generated by the second function module into the second material track of the video editing interface.

[0136] According to one or more embodiments of the present disclosure, in response to a third trigger operation for the second function module, inserting additional material generated by the second function module into a second material track of the video editing interface includes: in response to the third trigger operation for the second function module, displaying a setting interface of the second function module; in response to a second input operation for the setting interface, generating additional feature parameters, and based on the additional feature parameters, calling a multimodal model to process the second material to generate additional material; according to the material type of the additional material, inserting the additional material into the second material track corresponding to the material type in the video editing interface.

[0137] According to one or more embodiments of the present disclosure, the additional material includes one of the following: music material, text material, sticker material, and special effect material.

[0138] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a material editing device, including:

[0139] A display module for displaying a video editing interface, in which a first material track is set, and a first material is set in the first material track;

[0140] A first function module for, in response to a first trigger operation for the video editing interface, displaying a function module interface, where a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on feature parameters representing a clipping method;

[0141] A second function module for, in response to a second trigger operation for the first function module, replacing the first material in the first material track with a second material, where the second material is the result of automatically editing the first material by the first function module.

[0142] According to one or more embodiments of the present disclosure, the second function module is specifically configured to: in response to the second trigger operation for the first function module, display a setting interface of the first function module, where the setting interface is used to configure feature parameters of the corresponding function module; in response to a first input operation for the setting interface, obtain target feature parameters, and based on the target feature parameters, call a multimodal model to process the first material, determine a corresponding target clipping method, and based on the target clipping method, clip the first material to generate a second material; replace the first material in the first material track with the second material.

[0143] According to one or more embodiments of the present disclosure, the second functional module is specifically configured to: display a preview interface for displaying the second material and the target feature parameters; in response to a modification operation on the target feature parameters, update the second material and display the updated second material on the preview interface; when replacing the first material in the first material track with the second material, the second functional module is specifically configured to: in response to a save operation on the preview interface, replace the first material in the first material track with the second material.

[0144] According to one or more embodiments of the present disclosure, the first input operation includes a parameter input operation and a confirmation operation executed in sequence. The first functional module is further configured to: after responding to the confirmation operation, display a loading interface for displaying process text, and the process text is used to characterize the thinking process of the multimodal model for determining the target editing method based on the feature parameters.

[0145] According to one or more embodiments of the present disclosure, at least one second functional module is further provided in the functional module interface. The second functional module is used to generate additional materials that match the content of the first material. After generating the second material, the second functional module is further configured to: obtain a first processing link based on the target feature parameters and the second material, and the first processing link is used to characterize the order of triggering the second functional module; based on the first processing link, sequentially trigger at least one second functional module to generate at least one additional material; insert the at least one additional material into the corresponding second material track in the video editing interface respectively.

[0146] According to one or more embodiments of the present disclosure, when the second functional module obtains the first processing link based on the target feature parameters and the second material, it is specifically configured to: obtain a clip type based on the target feature parameters, and the clip type is used to characterize the lens switching method, and the clip type includes one of the following: chronological order, narrative order, form order, montage order; according to the clip type, determine the trigger quantity, trigger order of the second functional module to be triggered, and the additional feature parameters corresponding to the second functional module to be triggered; obtain the first processing link according to the trigger quantity, trigger order of the second functional module to be triggered, and the additional feature parameters corresponding to the second functional module to be triggered.

[0147] According to one or more embodiments of the present disclosure, at least one second functional module is further provided in the functional module interface, and the second functional module is used to generate additional materials for the material content matching the second material; the second functional module is further used to: in response to a third trigger operation for the second functional module, insert the additional materials generated by the second functional module into the second material track of the video editing interface.

[0148] According to one or more embodiments of the present disclosure, when the second functional module inserts the additional materials generated by the second functional module into the second material track of the video editing interface in response to a third trigger operation for the second functional module, it is specifically used to: in response to a third trigger operation for the second functional module, display the setting interface of the second functional module; in response to a second input operation for the setting interface, generate additional characteristic parameters, and call a multimodal model to process the second material based on the additional characteristic parameters to generate additional materials; according to the material type of the additional materials, insert the additional materials into the second material track corresponding to the material type in the video editing interface.

[0149] In a third aspect, according to one or more embodiments of the present disclosure, an electronic device is provided, including: at least one processor and a memory;

[0150] The memory stores computer-executable instructions;

[0151] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the material editing method as described in the first aspect above and various possible designs of the first aspect.

[0152] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, and computer-executable instructions are stored in the computer-readable storage medium. When the processor executes the computer-executable instructions, the material editing method as described in the first aspect above and various possible designs of the first aspect is implemented.

[0153] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the material editing method as described in the first aspect above and various possible designs of the first aspect is implemented.

[0154] The above description is only a preferred embodiment of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0155] In addition, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although a number of specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0156] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A material editing method, characterized in that, Including: Display a video editing interface, in which a first material track is set, and a first material is set in the first material track; In response to a first trigger operation on the video editing interface, display a function module interface, wherein a first function module is set in the function module interface, and the first function module is used to automatically edit the first material based on feature parameters representing the editing method; In response to a second trigger operation on the first function module, replace the first material in the first material track with a second material, where the second material is the result of automatically editing the first material by the first function module.

2. The method according to claim 1, wherein In response to a second trigger operation on the first function module, replacing the first material in the first material track with a second material includes: In response to a second trigger operation on the first function module, display a setting interface of the first function module, and the setting interface is used to configure the feature parameters of the corresponding function module; In response to a first input operation on the setting interface, obtain target feature parameters, call a multi-modal model to process the first material based on the target feature parameters, determine a corresponding target editing method, and edit the first material based on the target editing method to generate a second material; Replace the first material in the first material track with the second material.

3. The method according to claim 2, wherein After generating the second material, it further includes: Display a preview interface, and the preview interface is used to display the second material and the target feature parameters; In response to a modification operation on the target feature parameters, update the second material and display the updated second material on the preview interface; The replacing the first material in the first material track with the second material includes: In response to a save operation on the preview interface, replace the first material in the first material track with the second material.

4. The method according to claim 2, characterized in that, The first input operation includes a parameter input operation and a confirmation operation that are executed in sequence, and the method further includes: After responding to the confirmation operation, display a loading interface, and the loading interface is used to display process text, and the process text is used to represent the thinking process of the multi-modal model determining the target editing method based on the feature parameters.

5. The method according to claim 2, wherein At least one second function module is further set in the function module interface, and the second function module is used to generate additional materials that match the content of the first material. After generating the second material, the method further includes: According to the target feature parameters and the second material, obtain a first processing link, and the first processing link is used to represent the order of triggering the second function module; Based on the first processing link, sequentially trigger at least one second function module to generate at least one additional material; Insert the at least one additional material into the corresponding second material track in the video editing interface.

6. The method according to claim 2, characterized in that, According to the target feature parameters and the second material, obtaining a first processing link includes: Based on the target feature parameters, a clip type is obtained. The clip type is used to characterize the way of shot switching, and the clip type includes one of the following: chronological order, narrative order, form order, montage order; Based on the clip type, determine the number of triggers, the trigger order of the second functional module to be triggered, and the additional feature parameters corresponding to the second functional module to be triggered; Based on the number of triggers, the trigger order of the second functional module to be triggered, and the additional feature parameters corresponding to the second functional module to be triggered, obtain a first processing link.

7. The method according to claim 1, characterized in that At least one second functional module is further provided in the functional module interface. The second functional module is used to generate additional materials that match the materials of the second material. The method further includes: In response to a third trigger operation on the second functional module, insert the additional material generated by the second functional module into the second material track of the video editing interface.

8. The method according to claim 7, characterized in that, In response to a third trigger operation on the second functional module, inserting the additional material generated by the second functional module into the second material track of the video editing interface includes: In response to a third trigger operation on the second functional module, display the setting interface of the second functional module; In response to a second input operation on the setting interface, generate additional feature parameters, and based on the additional feature parameters, call a multimodal model to process the second material to generate additional materials; According to the material type of the additional material, insert the additional material into the second material track corresponding to the material type in the video editing interface.

9. The method according to claim 7, wherein The additional material includes one of the following: Music material, text material, sticker material, special effect material.

10. A material editing device, characterized in that, Including: A display module for displaying a video editing interface. The video editing interface is provided with a first material track, and the first material track is provided with a first material; A first functional module for, in response to a first trigger operation on the video editing interface, displaying a functional module interface, wherein the functional module interface is provided with a first functional module, and the first functional module is used to automatically edit the first material based on feature parameters representing the editing method; A second functional module, in response to a second trigger operation on the first functional module, replaces the first material in the first material track with a second material, and the second material is the result of automatically editing the first material by the first functional module.

11. An electronic device, characterized in that, Including: A processor and a memory; The memory stores computer execution instructions; The processor executes the computer execution instructions stored in the memory, so that the processor executes the material editing method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, Computer execution instructions are stored in the computer-readable storage medium. When the processor executes the computer execution instructions, the material editing method according to any one of claims 1 to 9 is implemented.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the material editing method according to any one of claims 1 to 9 is implemented.

Images