Media editing method and apparatus, device, and storage medium

Abstract

Embodiments of the present disclosure provide a media editing method and apparatus, a device, and a storage medium. The method comprises: presenting a media editing interface, the media editing interface comprising an editing track, and the editing track presenting at least one material; providing, in the editing interface, a first generation entry associated with the editing track; in response to the selection of the first generation entry, presenting a material generation window, the material generation window being used for acquiring at least one generation parameter; and adding, to the editing track, a first material generated on the basis of the at least one generation parameter, wherein an insertion position of the first material in the editing track is determined on the basis of a target position of an indicator in the editing track.

Description

Methods, apparatus, equipment and storage media for media editing

[0001] This application claims priority to Chinese Patent Application No. 202510059554.7, filed on January 14, 2025, entitled "Method, Apparatus, Device and Storage Medium for Media Editing", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to methods, apparatus, devices and computer-readable storage media for providing media editing. Background Technology

[0003] With the development of computer technology, people can now use computers to generate various types of media content. For example, people can input a piece of text and use generative techniques to generate corresponding media content, such as videos, images, and music. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for media editing is provided. The method includes: presenting a media editing interface, the media editing interface including an editing track, the editing track presenting at least one piece of material; providing a first generation entry point associated with the editing track in the editing interface; in response to selection of the first generation entry point, presenting a material generation window for acquiring at least one generation parameter; and adding a first piece of material generated based on the at least one generation parameter to the editing track, wherein the insertion position of the first piece of material in the editing track is determined based on a target position of an indicator in the editing track.

[0005] In a second aspect of this disclosure, an apparatus for media editing is provided. The apparatus includes: a presentation module configured to present a media editing interface including an editing track that presents at least one source clip; a providing module configured to provide a first generation entry point associated with the editing track in the editing interface; an acquisition module configured to present a source clip generation window in response to selection of the first generation entry point, the source clip generation window being used to acquire at least one generation parameter; and an adding module configured to add a first source clip generated based on the at least one generation parameter to the editing track, wherein the insertion position of the first source clip in the editing track is determined based on a target position of an indicator in the editing track.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figures 2A to 2C illustrate schematic diagrams of example editing interfaces according to some embodiments of the present disclosure;

[0013] Figures 3A and 3B illustrate schematic diagrams of example editing interfaces according to other embodiments of the present disclosure;

[0014] Figures 4A and 4B illustrate flowcharts for providing different types of generation entry points;

[0015] Figure 5 shows a schematic diagram of an example editing interface according to some other embodiments of the present disclosure;

[0016] Figure 6 illustrates a flowchart of an example process for media editing according to some embodiments of the present disclosure;

[0017] Figure 7 shows a schematic structural block diagram of an apparatus for media editing according to certain embodiments of the present disclosure;

[0018] Figure 8 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0019] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0020] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0021] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0022] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0023] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0024] In some scenarios, editing tools allow users to add footage generated using generative techniques. However, users typically need to rely on separate components to generate such footage and then manually add it, which impacts the efficiency of media editing.

[0025] Embodiments of this disclosure propose a media editing scheme. According to this scheme, a media editing interface is presented, including an editing track displaying at least one source material; a first generation entry point associated with the editing track is provided in the editing interface; in response to selection of the first generation entry point, a source material generation window is presented, the source material generation window being used to acquire at least one generation parameter; and a first source material generated based on the at least one generation parameter is added to the editing track, wherein the insertion position of the first source material in the editing track is determined based on a target position of an indicator in the editing track.

[0026] In this way, embodiments of this disclosure can support the insertion of generated footage into the editing track, thereby improving the efficiency of media editing. Furthermore, by determining the insertion position of the footage through the position of the indicator, embodiments of this disclosure can improve the accuracy of media editing.

[0027] Example Environment

[0028] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0029] In this example environment 100, electronic device 110 may run an application 120 that supports the generation of video content. Application 120 may be any suitable type of application for media editing, examples of which may include, but are not limited to, video applications, editing applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0030] In environment 100 of Figure 1, if application 120 is active, application 120 can provide a presentation interface 150 for user 140.

[0031] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of interface for the target user (such as "wearable" circuitry).

[0032] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0033] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0034] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0035] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0036] Example Interaction

[0037] The following description of an example interaction process according to an embodiment of the present disclosure will be made with reference to Figures 2A-2C. Figures 2A-2C illustrate example interfaces 200A-200C according to some embodiments of the present disclosure, which may be provided, for example, by the electronic device 110 shown in Figure 1.

[0038] As shown in Figure 2A, the electronic device 110 can provide a media editing interface 200A. The interface 200A can provide a multitrack editor for editing media content; the interface 200A is also called a multitrack editing interface.

[0039] As shown in the figure, interface 200A may include editing track 205. Editing track 205 may include one or more materials from the media draft, such as material 210. As an example, material 210 may include image material or video material, and its length in editing track 205 may correspond to the duration of material 210.

[0040] In addition, the editing track 205 can also be associated with the indicator 215, allowing users to browse the media draft at different times by dragging the indicator 215.

[0041] In some embodiments, as shown in FIG2A, the electronic device 110 may also provide multiple editing entries in the interface 200A, such as an audio editing entry, a text editing entry, etc.

[0042] As an example, the electronic device 110 can receive the user's selection of the editing entry 220 ("Add Material") and can present the interface 200B as shown in Figure 2B.

[0043] As shown in Figure 2B, the electronic device 110 can provide one or more generation entry points associated with the editing track 205. For example, the electronic device 110 can provide an image generation entry point 225 and a video generation entry point 230 in the interface 200B.

[0044] In some embodiments, image generation entry 225 and video generation entry 230 can be collectively referred to as material generation entry, which can trigger the presentation of a material generation window. Such a material generation window can be used to obtain at least one generation parameter input by the user and can trigger the generation of materials using a generative model.

[0045] The process of generating materials will be described in detail below with reference to Figure 5, and will not be elaborated on here.

[0046] As shown in Figure 2C, the electronic device 110 can add the generated material 235 to the editing track 205. As an example, the electronic device 110 can present multiple candidate materials generated based on at least one generation parameter, and can receive a selection of material 235 from the generated multiple candidate materials. Accordingly, the electronic device 110 can add the selected material 235 to the editing track 205.

[0047] As another example, the electronic device 110 can also automatically add material 235 to the editing track 205 without requiring the user to select material 235.

[0048] In some embodiments, material 235 may include, for example, image material or video material. Image material may correspond to a preset duration; the duration of video material may be determined based on generation parameters configured by the user.

[0049] In some embodiments, the insertion position of material 235 in the editing track 205 is determined based on the target position of indicator 215 in the editing track 205.

[0050] As shown in Figure 2B, when a generation request is triggered, the indicator 215 may be located within the material 210, for example.

[0051] In some scenarios, the electronic device 110 can, for example, segment the material 210 based on the position of the indicator 210, and insert the generated material at the segmentation position of the material 210.

[0052] In some embodiments, the electronic device 110 may also determine the relative positional relationship between the indicator 215 and the material 210 based on the position of the indicator 210. For example, the relative positional relationship may indicate that the indicator 215 is located in the front half or the rear half of the material 210.

[0053] Furthermore, the electronic device 110 can determine the insertion position of the material 235 based on relative positional relationships, wherein the insertion position is before or after the material 210. For example, if the indicator 215 is located in the first half of the material 210, the insertion position can be before the material 210. Conversely, if the indicator 215 is located in the second half of the material 210, the insertion position can be after the material 210.

[0054] Taking Figure 2C as an example, since the indicator 215 is located in the first half of the material 210, the electronic device 110 can insert the generated material 235 before the material 210.

[0055] Based on this approach, embodiments of this disclosure can support the rapid insertion of generated materials into the editing track, thereby improving the efficiency of media editing.

[0056] The media editing process according to some embodiments of the present disclosure will continue to be described below with reference to Figures 3A and 3B. Figures 3A and 3B illustrate example interfaces 300A to 300B according to some embodiments of the present disclosure, which may be provided, for example, by the electronic device 110 shown in Figure 1.

[0057] As shown in Figure 3A, the editing track 305 in interface 300A can include material 310. Electronic device 110 can receive selections of material 310. For example, a user can select material 310 by clicking on it.

[0058] Furthermore, the electronic device 110 may provide one or more generation entry points associated with the material 310 in the interface 300A. As an example, such generation entry points may include an image generation entry point 315 and / or a video generation entry point 320.

[0059] As illustrated in Figure 4A, the type of the provided generation entry can be determined based on the attribute information of the selected material 310.

[0060] As shown in Figure 4A, the electronic device 110 can determine that the selected material 310 is image material 405. Further, in box 410, the electronic device 110 can determine whether the image material 405 was generated using an image generation component.

[0061] If the image material 405 is generated using an image generation component, the electronic device 110 can provide a video generation entry 415 and / or an image generation entry 420 based on the selection of the image material 405.

[0062] As shown in Figure 4A, in response to receiving a selection at the video generation entry 415, the electronic device 110 can further determine in box 425 whether the image material 405 has been used to generate historical video material. If the image material has been used to generate a set of historical video material, the video generation entry 415 can trigger the display of the material selection window (also known as the video generation result page). Accordingly, in box 430, the electronic device 110 can present the video generation result page and can present a set of historical video material generated based on the image material.

[0063] Accordingly, the electronic device 110 can, for example, receive a selection of video footage from the set of historical video footage and add the video footage to the editing track. Alternatively, the electronic device 110 can also use the video footage to replace the selected image footage.

[0064] Conversely, if it is determined in box 425 that the image material 405 has not been used to generate historical video material, the electronic device 110 may present a first video generation window (also known as a video generation input page), which is configured to generate video material based on the image material 405. As an example, in box 435, the electronic device 110 may present a video generation input page to obtain one or more generation parameters for generating video material.

[0065] Referring again to Figure 4A, if it is determined in box 410 that image material 405 was not generated using the image generation component, then in response to the selection of image material 405, electronic device 110 will only provide video generation entry 445, and not image generation entry. Accordingly, video generation entry 445 can trigger the presentation of a video generation input page in box 450. For example, electronic device 110 can present a video generation window based on the selection of video generation entry 445, which is configured to generate video material based on image material 405.

[0066] Furthermore, as shown in Figure 4B, the electronic device 110 can determine that the selected material 310 is video material 455. Further, in box 460, the electronic device 110 can determine whether the video material 455 was generated using a video generation component.

[0067] If video footage 455 is generated using a video generation component, the electronic device 110 will at least present a video generation entry associated with video footage 455, such as video generation entry 470 or video generation entry 490. Both video generation entry 470 and video generation entry 490 can be used to trigger the presentation of a set of historical video footage generated by the video generation component. That is, video generation entry 470 can trigger the presentation of the video generation result page in box 480, and video generation entry 490 can trigger the presentation of the video generation result page in box 495.

[0068] Specifically, as shown in Figure 4B, the electronic device 110 can also determine in box 465 whether the image on which the generated video material 455 is based was generated using an image generation component. If so, the electronic device 110 can further provide an image generation entry 475, which can trigger the presentation of the image generation result page in box 485. For example, the electronic device 110 can present a set of historical images generated by the image generation component based on the selection of the image generation entry 475.

[0069] In this way, the embodiments of this disclosure can provide a unified interactive entry point for different types of materials, and can configure different triggering logic based on the different attribute information of the selected materials.

[0070] Referring again to Figure 3A, as an example, if material 310 is an image material generated using an image generation component, then electronic device 110 may, for example, trigger the presentation of interface 300B as shown in Figure 3B based on the selection of image generation entry 315.

[0071] As shown in Figure 3B, the electronic device 110 can display a set of historical image materials generated by the image generation component in the interface 300B, such as material 325, material 330, material 335, and material 340. As an example, the electronic device 110 can receive the user's selection of material 330 and can trigger the replacement of material 310 in the editing track 305 with material 330.

[0072] As another example, electronic device 110 may also trigger the regeneration of a new set of image materials based on historical generation parameters, for example, based on the selection of control 345. Alternatively, electronic device 110 may also provide a parameter modification window based on the selection of control 350 to allow users to reconfigure image generation parameters.

[0073] The following description uses Figure 5 as an example to illustrate a sample material generation window. Figure 5 shows an example interface 500 according to some embodiments of this disclosure.

[0074] As shown in Figure 5, the electronic device 110 can, for example, present the interface 500 shown in Figure 5 based on the selection of the image generation entry 225 discussed with reference to Figure 2B. It should be understood that although Figure 5 uses image generation as an example to describe an example process of material generation, this approach can also be applied, for example, to the process of video material generation.

[0075] As shown in Figure 5, interface 500 can provide one or more input controls for obtaining generation parameters. As an example, such input controls may include prompt input controls, parameter graph setting controls 505, model selection controls, and frame setting controls, etc.

[0076] In some embodiments, the electronic device 110 can acquire at least one reference image for generating image or video footage via a reference image setting control 505. As an example, the electronic device 110 can receive a selection on the reference image setting control 505 and can present an image acquisition interface for acquiring reference images uploaded or captured by a user.

[0077] In some embodiments, the electronic device 110 may support users adding multiple reference images. As an example, the electronic device 110 may determine the type of reference information corresponding to each reference image based on the user's configuration operations.

[0078] As an example, the type of reference information can include multiple preset types, and users can select the type corresponding to each reference image from the multiple preset types.

[0079] In some embodiments, the type of reference information may include a first type, wherein the first type may indicate the generation of material based on the composition information of a corresponding reference image. For example, the composition information indicates the layout of the reference image, such as the position of a specific object in the image, the positional relationship of multiple objects in the image, etc. As an example, the contour information and depth information of the reference image can be extracted to characterize the composition information of the reference image.

[0080] In some embodiments, the type of reference information may further include a second type, wherein the second type indicates that the first material is generated based on scene information of the corresponding reference image. For example, the scene information indicates the background of at least one reference image, such background image may be preserved. As an example, the background region in the reference image can be determined by a segmentation model and provided to the material generation model for generating the first material.

[0081] In some embodiments, the types of reference information may include, but are not limited to: subject information, outline information, image style information, pose information, depth information, etc.

[0082] In some embodiments, the electronic device 110 may also support adding multiple reference images. In some scenarios, the multiple reference images correspond to the same type of reference information. Alternatively, the multiple reference images may correspond to different types of reference information.

[0083] In some scenarios, certain types of reference information are not allowed to be added simultaneously. Conversely, some types of reference information are allowed to be added simultaneously as different control signals for controlling the generation of footage.

[0084] As shown in Figure 5, after the corresponding reference images are added, the electronic device 110 can display labels 510 corresponding to each reference image. These labels 510 can indicate the type of reference information corresponding to each reference image. Taking Figure 5 as an example, the user can configure three reference images, and the types of reference information corresponding to the three reference images are: subject information, composition information, and scene information, respectively.

[0085] In some embodiments, users can also quickly delete a reference image, replace a reference image, or change the type of reference information by editing label 510.

[0086] It should be understood that such reference information can be provided to the material generation model as a control signal to control the material generation process.

[0087] Based on this approach, embodiments of this disclosure can further improve the quality of generated materials, thereby enhancing the efficiency of media editing.

[0088] Example process

[0089] Figure 6 illustrates a flowchart of an example media editing process 600 according to some embodiments of the present disclosure. Process 600 can be implemented at an electronic device 110. Process 600 will now be described with reference to Figure 1.

[0090] As shown in the figure, in box 610, the electronic device 110 presents a media editing interface, which includes an editing track and presents at least one piece of material.

[0091] In box 620, electronic device 110 provides a first generation entry point associated with the edit track in the editing interface.

[0092] In box 630, in response to the selection of the first generation entry, the electronic device 110 presents a material generation window, which is used to obtain at least one generation parameter.

[0093] In box 640, electronic device 110 adds a first clip generated based on at least one generation parameter to an editing track, wherein the insertion position of the first clip in the editing track is determined based on the target position of an indicator in the editing track.

[0094] In some embodiments, adding a first clip generated based on at least one generation parameter to an edit track includes: in response to an indicator being located within a second clip in at least one clip, splitting the second clip based on the target position of the indicator; and inserting the generated first clip at the split position.

[0095] In some embodiments, adding a first clip generated based on at least one generation parameter to an edit track includes: in response to an indicator being located within a third clip in at least one clip, determining a relative positional relationship between the indicator and the third clip based on a target position of the indicator; determining an insertion position for the first clip based on the relative positional relationship, wherein the insertion position is before or after the third clip; and inserting the generated first clip at the insertion position.

[0096] In some embodiments, process 600 further includes: receiving a selection of a target material from at least one material; and presenting a second generation entry associated with the target material, the type of which is determined based on attribute information of the target material.

[0097] In some embodiments, presenting a second generation entry associated with the target material includes: in response to the target material being an image material, determining whether the image material was generated using an image generation component; and in response to the image material being generated using an image generation component, presenting an image generation entry and / or a video generation entry associated with the image material.

[0098] In some embodiments, process 600 further includes: in response to the selection of an image generation entry, presenting a set of historical image materials associated with the image materials, the set of historical image materials being generated using the image generation component.

[0099] In some embodiments, process 600 further includes: determining whether image materials are used to generate historical video materials in response to the selection of a video generation entry; and presenting a set of historical video materials in a material selection window in response to the image materials being used to generate a set of historical video materials.

[0100] In some embodiments, process 600 further includes: in response to the image material not being used to generate historical video material, presenting a first video generation window, the first video generation window being configured to generate video material based on the image material.

[0101] In some embodiments, process 600 further includes: in response to the image material not being generated using the image generation component, presenting a video generation entry associated with the image material; and in response to the selection of the video generation entry, presenting a second video generation window, the second video generation window being configured to generate video material based on the image material.

[0102] In some embodiments, presenting a second generation entry associated with the target material includes: in response to the target material being video material, determining whether the video material was generated using a video generation component; in response to the video material being generated using a video generation component, presenting a video generation entry associated with the video material, wherein the video generation entry is configured to trigger the presentation of a set of historical video materials generated by the video generation component.

[0103] In some embodiments, process 600 further includes: in response to whether the image on which the video material is based was generated using an image generation component, presenting an image generation entry associated with the video material, the image generation entry being configured to trigger the presentation of a set of historical images generated by the image generation component.

[0104] In some embodiments, process 600 further includes: providing a reference image setting control in a material generation window; and obtaining at least one reference image for generating the first material via the reference image setting control.

[0105] In some embodiments, at least one reference image includes multiple reference images, which correspond to the same type of reference information or different types of reference information.

[0106] In some embodiments, process 600 further includes: determining the type of reference information corresponding to at least one reference image via a reference image setting control.

[0107] In some embodiments, the type includes a first type, which indicates that the first material is generated based on compositional information from at least one reference image.

[0108] In some embodiments, the type includes a second type, which indicates that the first material is generated based on scene information from at least one reference image.

[0109] Example devices and equipment

[0110] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. FIG7 shows a schematic structural block diagram of an example apparatus 700 for media editing according to certain embodiments of this disclosure. Apparatus 700 may be implemented as or included in electronic device 110. The various modules / components in apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0111] As shown in Figure 7, the device 700 includes a presentation module 710 configured to present a media editing interface, the media editing interface including an editing track, the editing track presenting at least one piece of material; a providing module 720 configured to provide a first generation entry associated with the editing track in the editing interface; an acquisition module 730 configured to present a material generation window in response to selection of the first generation entry, the material generation window being used to acquire at least one generation parameter; and an adding module 740 configured to add a first piece of material generated based on at least one generation parameter to the editing track, wherein the insertion position of the first piece of material in the editing track is determined based on the target position of an indicator in the editing track.

[0112] In some embodiments, the rendering module 710 is further configured to: in response to an indicator being located within a second material in at least one material, segment the second material based on the target position of the indicator; and insert the generated first material at the segmentation position.

[0113] In some embodiments, the adding module 740 is further configured to: in response to the indicator being located within a third material in at least one material, determine the relative positional relationship between the indicator and the third material based on the target position of the indicator; determine the insertion position of the first material based on the relative positional relationship, wherein the insertion position is before or after the third material; and insert the generated first material at the insertion position.

[0114] In some embodiments, the apparatus 700 further includes a first receiving module configured to receive a selection of a target material from at least one material; and to present a second generation entry associated with the target material, the type of which is determined based on attribute information of the target material.

[0115] In some embodiments, the first receiving module is further configured to: determine whether the image material was generated using an image generation component in response to the target material being an image material; and present an image generation entry and / or a video generation entry associated with the image material in response to the image material being generated using an image generation component.

[0116] In some embodiments, the device 700 further includes a material presentation module configured to present a set of historical image materials associated with the image materials in response to the selection of an image generation entry, the set of historical image materials being generated using the image generation component.

[0117] In some embodiments, the apparatus 700 further includes a first determining module configured to determine whether image material is used to generate historical video material in response to the selection of a video generation entry; and to present a set of historical video material in a material selection window in response to the image material being used to generate a set of historical video material.

[0118] In some embodiments, the device 700 further includes a window presentation module configured to present a first video generation window in response to the image material not being used to generate historical video material, the first video generation window being configured to generate video material based on the image material.

[0119] In some embodiments, the device 700 further includes a first entry presentation module configured to present a video generation entry associated with the image material in response to the image material not being generated using the image generation component; and to present a second video generation window in response to the selection of the video generation entry, the second video generation window being configured to generate video material based on the image material.

[0120] In some embodiments, the first receiving module is further configured to: determine whether the video material was generated using a video generation component in response to the target material being video material; and present a video generation entry associated with the video material in response to the video material being generated using a video generation component, wherein the video generation entry is configured to trigger the presentation of a set of historical video materials generated by the video generation component.

[0121] In some embodiments, the device 700 further includes a second entry presentation module configured to present an image generation entry associated with the video material in response to whether the image on which the video material is based was generated using an image generation component. The image generation entry is configured to trigger the presentation of a set of historical images generated by the image generation component.

[0122] In some embodiments, the apparatus 700 further includes a control providing module configured to provide a reference image setting control in a material generation window; and to obtain at least one reference image for generating the first material via the reference image setting control.

[0123] In some embodiments, at least one reference image includes multiple reference images, which correspond to the same type of reference information or different types of reference information.

[0124] In some embodiments, the device 700 further includes a second determining module configured to determine the type of reference information corresponding to at least one reference image via a reference image setting control.

[0125] In some embodiments, the type includes a first type, which indicates that the first material is generated based on compositional information from at least one reference image.

[0126] In some embodiments, the type includes a second type, which indicates that the first material is generated based on scene information from at least one reference image.

[0127] The modules included in device 700 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the modules in device 700 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0128] Figure 8 shows a block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 800 shown in Figure 8 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 800 shown in Figure 8 can be used to implement the electronic device 110 of Figure 1.

[0129] As shown in Figure 8, the electronic device 800 is in the form of a general-purpose electronic device. Components of the electronic device 800 may include, but are not limited to, one or more processors or processing units 810, memory 820, storage devices 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be a physical or virtual processor and is capable of performing various processes according to programs stored in the memory 820. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 800.

[0130] Electronic device 800 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 820 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 830 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 800.

[0131] Electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG8, disk drives for reading or writing from removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading or writing from removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 820 may include computer program product 825 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0132] The communication unit 840 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 800 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 800 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0133] Input device 850 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 860 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 800 can also communicate with one or more external devices (not shown) via communication unit 840 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 800, or with any device that enables electronic device 800 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0134] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0135] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0136] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0137] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0138] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0139] Various implementations of this disclosure have been described above. The foregoing description is exemplary and not exhaustive, nor is it limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for media editing, comprising: A media editing interface is presented, which includes an editing track and displays at least one piece of material. The editing interface provides a first generation entry point associated with the editing track; In response to the selection of the first generation entry point, a material generation window is presented, which is used to obtain at least one generation parameter; as well as Add a first material generated based on the at least one of the generation parameters to the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of the indicator in the editing track.

2. The method of claim 1, wherein adding the first material generated based on the at least one generation parameter in the editing track comprises: In response to the indicator being located within a second material in the at least one material, the second material is segmented based on the target position of the indicator; as well as Insert the first material generated at the segmentation location.

3. The method of claim 1, wherein adding the first material generated based on the at least one generation parameter in the editing track comprises: In response to the indicator being located within a third material among the at least one material, the relative positional relationship between the indicator and the third material is determined based on the target position of the indicator; Based on the relative positional relationship, the insertion position of the first material is determined, wherein the insertion position is before or after the third material; as well as The generated first material is inserted at the insertion position.

4. The method according to claim 1, further comprising: Receive selection of a target material from the at least one material; as well as A second generation entry point associated with the target material is presented, the type of which is determined based on the attribute information of the target material.

5. The method of claim 4, wherein presenting a second generation entry associated with the target material comprises: In response to the fact that the target material is an image material, determine whether the image material was generated using an image generation component; In response to the image material being generated using the image generation component, an image generation entry and / or video generation entry associated with the image material are presented.

6. The method according to claim 5, further comprising: In response to the selection of the image generation entry, a set of historical image materials associated with the image material are presented, the set of historical image materials being generated using the image generation component.

7. The method according to claim 5, further comprising: In response to the selection of the video generation entry point, determine whether the image material is used to generate historical video material; as well as In response to the image material being used to generate a set of historical video materials, the set of historical video materials is presented in the material selection window.

8. The method according to claim 7, further comprising: In response to the image material not being used to generate historical video material, a first video generation window is presented, which is configured to generate video material based on the image material.

9. The method according to claim 5, further comprising: In response to the fact that the image material was not generated using the image generation component, a video generation entry point associated with the image material is presented; as well as In response to the selection of the video generation entry, a second video generation window is presented, which is configured to generate video material based on the image material.

10. The method of claim 4, wherein presenting a second generation entry associated with the target material comprises: In response to the fact that the target material is video material, determine whether the video material was generated using a video generation component; In response to the video material being generated using the video generation component, a video generation entry associated with the video material is presented, and the video generation entry is configured to trigger the presentation of a set of historical video materials generated by the video generation component.

11. The method of claim 10, further comprising: In response to whether the image on which the video material is based was generated using an image generation component, an image generation entry associated with the video material is presented. The image generation entry is configured to trigger the presentation of a set of historical images generated by the image generation component.

12. The method according to claim 1, further comprising: A reference image setting control is provided in the material generation window; as well as At least one reference image is obtained for generating the first material via the reference image setting control.

13. The method of claim 12, wherein the at least one reference image comprises a plurality of reference images, the plurality of reference images corresponding to reference information of the same type or reference information of different types.

14. The method of claim 12, further comprising: The type of reference information corresponding to the at least one reference image is determined via the reference image setting control.

15. The method of claim 14, wherein the type includes a first type, the first type indicating that the first material is generated based on compositional information of the at least one reference image.

16. The method of claim 14, wherein the type includes a second type, the second type indicating that the first material is generated based on scene information of the at least one reference image.

17. An apparatus for media editing, comprising: A presentation module is configured to present a media editing interface, the media editing interface including an editing track, the editing track presenting at least one piece of material; A module is provided, configured to provide a first generation entry point associated with the edit track in the editing interface; The acquisition module is configured to present a material generation window in response to the selection of the first generation entry point, the material generation window being used to acquire at least one generation parameter; as well as An add module is configured to add a first material generated based on the at least one generation parameter to the edit track, wherein the insertion position of the first material in the edit track is determined based on the target position of an indicator in the edit track.

18. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processor.

19. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 16.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 16.

Images