Media editing method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a media editing method and device, equipment and a storage medium. The method comprises the steps that a media editing interface is presented, the media editing interface comprises an editing track, and the editing track presents at least one item of material; providing a first generation entry associated with the editing track in the editing interface; in response to the selection of the first generation entry, presenting a material generation window, the material generation window being used for obtaining at least one generation parameter; and adding a first material generated based on the at least one generation parameter in the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of the indicator in the editing track. In this way, the media editing efficiency can be improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for providing media editing. Background Art

[0002] With the development of computer technology, people can use computers to generate various types of media content. For example, people can input a piece of text and use generative technology to generate corresponding media content, such as videos, images, music, etc. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for media editing is provided. The method includes: presenting a media editing interface, the media editing interface including an editing track, the editing track presenting at least one material; providing a first generation entry associated with the editing track in the editing interface; in response to a selection of the first generation entry, presenting a material generation window, the material generation window being used to obtain at least one generation parameter; and adding the first material generated based on the at least one generation parameter to the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of an indicator in the editing track.

[0004] In a second aspect of the present disclosure, a device for media editing is provided. The device includes: a presentation module configured to present a media editing interface, the media editing interface includes an editing track, and the editing track presents at least one material; a provision module configured to provide a first generation entry associated with the editing track in the editing interface; an acquisition module configured to present a material generation window in response to a selection of the first generation entry, the material generation window being used to acquire at least one generation parameter; and an addition module configured to add the first material generated based on the at least one generation parameter in the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of the indicator in the editing track.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] FIG. 2A to FIG. 2C A schematic diagram showing an example editing interface according to some embodiments of the present disclosure is shown;

[0011] Figure 3A and Figure 3B A schematic diagram showing an example editing interface according to some other embodiments of the present disclosure;

[0012] Figure 4A and Figure 4B A flow chart showing different types of generation entry is provided;

[0013] Figure 5 A schematic diagram showing an example editing interface according to still other embodiments of the present disclosure;

[0014] Figure 6 A flowchart illustrating an example process of media editing according to some embodiments of the present disclosure;

[0015] Figure 7 A schematic structural block diagram of an apparatus for media editing according to some embodiments of the present disclosure is shown;

[0016] Figure 8 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0020] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects are subject to the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user knows and confirms. Accordingly, when implementing each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0021] In this specification and the embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the subject of personal information, or it is necessary to perform a contract, etc.), and will only be processed within the scope of regulations or agreements. If a user refuses to process personal information other than the necessary information for basic functions, it will not affect the user's use of basic functions.

[0022] In some scenarios, some editing tools can, for example, support users to add materials generated using generation techniques. However, users usually need to rely on independent components to generate such materials, and need to further add them manually, which affects the efficiency of media editing.

[0023] The embodiment of the present disclosure proposes a scheme for media editing. According to the scheme, a media editing interface is presented, the media editing interface includes an editing track, and the editing track presents at least one material; a first generation entry associated with the editing track is provided in the editing interface; in response to the selection of the first generation entry, a material generation window is presented, and the material generation window is used to obtain at least one generation parameter; and the first material generated based on the at least one generation parameter is added to the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of the indicator in the editing track.

[0024] In this way, the embodiment of the present disclosure can support the insertion of generated materials in the editing track, thereby improving the efficiency of media editing. In addition, by determining the insertion position of the material through the position of the indicator, the embodiment of the present disclosure can improve the accuracy of media editing.

[0025] Example Environment

[0026] Figure 1 1 is a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, example environment 100 may include electronic device 110 .

[0027] In this example environment 100, an electronic device 110 may run an application 120 that supports the generation of video content. The application 120 may be any suitable type of application for media editing, examples of which may include, but are not limited to, video applications, editing applications, or other suitable applications. A user 140 may interact with the application 120 via the electronic device 110 and / or its attached devices.

[0028] exist Figure 1 In the environment 100 , if the application 120 is in an active state, the application 120 may provide a presentation interface 150 for the user 140 .

[0029] In some embodiments, the electronic device 110 communicates with the server 130 to provide services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a game device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the target user (such as a "wearable" circuit, etc.).

[0030] The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 120 that supports interface interaction in the electronic device 110.

[0031] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0032] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0033] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0034] Example Interaction

[0035] The following will refer to Figure 2A-2C To describe an example interaction process according to an embodiment of the present disclosure. FIG. 2A to FIG. 2C Example interfaces 200A to 200C according to some embodiments of the present disclosure are shown. Interfaces 200A to 200C may be composed of, for example, Figure 1 The electronic device 110 is provided as shown.

[0036] like Figure 2A As shown, the electronic device 110 may provide a media editing interface 200A. The interface 200A may provide a multi-track editor for editing media content, and the interface 200A is also referred to as a multi-track editing interface.

[0037] As shown, the interface 200A may include an editing track 205. The editing track 205 may include one or more materials in the media draft, for example, material 210. As an example, the material 210 may include a picture material or a video material, and its length in the editing track 205 may correspond to the duration of the material 210.

[0038] In addition, the editing track 205 may also be associated with an indicator 215 , and the user may browse the images of the media draft at different moments by, for example, dragging the indicator 215 .

[0039] In some embodiments, Figure 2A As shown, the electronic device 110 may also provide multiple editing entries in the interface 200A, for example, an audio editing entry, a text editing entry, etc.

[0040] As an example, the electronic device 110 may receive a user's selection of the editing entry 220 ("add material") and may present a Figure 2B Interface 200B is shown.

[0041] like Figure 2B As shown, the electronic device 110 may provide one or more generation portals associated with the editing track 205. For example, the electronic device 110 may provide a picture generation portal 225 and a video generation portal 230 in the interface 200B.

[0042] In some embodiments, the image generation entry 225 and the video generation entry 230 may be collectively referred to as a material generation entry, which may trigger the presentation of a material generation window. Such a material generation window may be used to obtain at least one generation parameter input by a user, and may trigger the generation of material using a generative model.

[0043] The process of material generation will be referred to below Figure 5 It will be described in detail later and will not be described in detail here.

[0044] like Figure 2CAs shown, the electronic device 110 can add the generated material 235 to the editing track 205. As an example, the electronic device 110 can present multiple candidate materials generated based on at least one generation parameter, and can receive a selection of the material 235 from the generated multiple candidate materials. Accordingly, the electronic device 110 can add the selected material 235 to the editing track 205.

[0045] As another example, the electronic device 110 may also automatically add the material 235 to the editing track 205 without requiring the user to select the material 235 .

[0046] In some embodiments, the material 235 may include, for example, picture material or video material. The picture material may correspond to a preset duration, for example; the duration of the video material may be determined based on generation parameters configured by the user.

[0047] In some embodiments, the insertion position of the material 235 in the edit track 205 is determined based on the target position of the indicator 215 in the edit track 205 .

[0048] like Figure 2B As shown, indicator 215 , for example, may be located within asset 210 when a request to generate is triggered.

[0049] In some scenarios, the electronic device 110 may, for example, segment the material 210 based on the position of the indicator 210 , and may insert the generated material at the segmented position of the material 210 .

[0050] In some embodiments, the electronic device 110 may also determine the relative position relationship between the indicator 215 and the material 210 based on the position of the indicator 210. For example, the relative position relationship may indicate that the indicator 215 is located in the first half or the second half of the material 210.

[0051] Further, the electronic device 110 may determine the insertion position of the material 235 based on the relative position relationship, wherein the insertion position is before the material 210 or after the material 210. For example, if the indicator 215 is located in the first half of the material 210, the insertion position may be before the material 210. On the contrary, if the indicator 215 is located in the second half of the material 210, the insertion position may be after the material 210.

[0052] by Figure 2C As an example, since the indicator 215 is located in the first half of the material 210 , the electronic device 110 may insert the generated material 235 before the material 210 .

[0053] Based on this approach, the embodiments of the present disclosure can support the rapid insertion of generated materials into the editing track, thereby improving the efficiency of media editing.

[0054] The following will continue to refer to Figure 3A and Figure 3B To describe the media editing process according to some embodiments of the present disclosure. FIG. 3A to FIG. 3B Example interfaces 300A to 300B according to some embodiments of the present disclosure are shown. Interfaces 300A to 300B may be composed of, for example, Figure 1 The electronic device 110 is provided as shown.

[0055] like Figure 3A As shown, the editing track 305 in the interface 300A may include a material 310. The electronic device 110 may receive a selection of the material 310. For example, the user may select the material 310 by clicking on the material 310.

[0056] Further, the electronic device 110 may provide one or more generation portals associated with the material 310 in the interface 300A. As an example, such generation portals may include a picture generation portal 315 and / or a video generation portal 320.

[0057] If you will refer to Figure 4A As described above, the type of the generated entry provided may be determined based on the attribute information of the selected material 310 .

[0058] like Figure 4A As shown, the electronic device 110 may determine that the selected material 310 is a picture material 405. Further, in block 410, the electronic device 110 may determine whether the picture material 405 is generated using a picture generation component.

[0059] If the picture material 405 is generated by using a picture generation component, the electronic device 110 may provide a video generation entry 415 and / or a picture generation entry 420 based on the selection of the picture material 405 .

[0060] like Figure 4A As shown, in response to receiving the selection of the video generation entry 415, the electronic device 110 can further determine whether the picture material 405 has been used to generate a historical video material in box 425. If the picture material has been used to generate a set of historical video materials, the video generation entry 415 can trigger a display material selection window (also referred to as a result page of video generation). Accordingly, in box 430, the electronic device 110 can present a result page of video generation, and can present a set of historical video materials generated based on the picture material.

[0061] Accordingly, the electronic device 110 may receive a selection of a video material in the set of historical video materials, and may add the video material to the editing track. Alternatively, the electronic device 110 may also use the video material to replace the selected picture material.

[0062] On the contrary, if it is determined in block 425 that the picture material 405 has not been used to generate historical video material, the electronic device 110 may present a first video generation window (also referred to as an input page for video generation), wherein the first video generation window is configured to generate video material based on the picture material 405. As an example, in block 435, the electronic device 110 may present an input page for video generation to obtain one or more generation parameters for generating video material.

[0063] Continue to refer Figure 4A If it is determined in block 410 that the picture material 405 is not generated using the picture generation component, then in response to the selection of the picture material 405, the electronic device 110 will only provide a video generation entry 445, but not a picture generation entry. Accordingly, the video generation entry 445 may trigger the presentation of an input page for video generation in block 450. For example, the electronic device 110 may present a video generation window based on the selection of the video generation entry 445, and the video generation window is configured to generate video material based on the picture material 405.

[0064] In addition, if Figure 4B As shown, the electronic device 110 may determine that the selected material 310 is a video material 455. Further, in block 460, the electronic device 110 may determine whether the video material 455 is generated using a video generation component.

[0065] If the video material 455 is generated using a video generation component, the electronic device 110 will at least present a video generation entry associated with the video material 455, such as a video generation entry 470 or a video generation entry 490. Both the video generation entry 470 and the video generation entry 490 can be used to trigger the presentation of a group of historical video materials generated by the video generation component. That is, the video generation entry 470 can trigger the presentation of a result page of video generation at box 480, and the video generation entry 490 can trigger the presentation of a result page of video generation at box 495.

[0066] Specifically, if Figure 4BAs described above, the electronic device 110 may also determine whether the image based on which the video material 455 is generated is generated using the image generation component at block 465. If so, the electronic device 110 may further provide an image generation entry 475, which may trigger the presentation of the image generation result page at block 485. For example, the electronic device 110 may present a set of historical images generated by the image generation component based on the selection of the image generation entry 475.

[0067] In this way, the embodiments of the present disclosure can provide a unified interactive entrance for different types of materials, and can configure different trigger logics based on different attribute information of the selected materials.

[0068] Continue to refer Figure 3A As an example, if the material 310 is a picture material generated by using a picture generation component, the electronic device 110 may trigger the presentation of the picture based on the selection of the picture generation entry 315. Figure 3B Interface 300B is shown.

[0069] like Figure 3B As shown, the electronic device 110 can present a group of historical picture materials generated by the picture generation component in the interface 300B, such as material 325, material 330, material 335 and material 340. As an example, the electronic device 110 can receive a user's selection of material 330, and can trigger the use of material 330 to replace material 310 in the editing track 305.

[0070] As another example, the electronic device 110 may also trigger the regeneration of a new set of picture materials based on the historical generation parameters based on the selection of the control 345. Alternatively, the electronic device 110 may also provide a parameter modification window based on the selection of the control 350 to support the user to reconfigure the picture generation parameters.

[0071] The following will be Figure 5 An example of a material generation window is described as an example. Figure 5 An example interface 500 is shown in accordance with some embodiments of the present disclosure.

[0072] like Figure 5 As shown, the electronic device 110 can, for example, be based on a reference Figure 2B The selection of the picture generation entry 225 discussed is presented as Figure 5 The interface 500 shown. It should be understood that although Figure 5 The example process of material generation is described by taking image generation as an example, but such an approach can also be applied to the process of video material generation, for example.

[0073] like Figure 5As shown, the interface 500 may provide one or more input controls for obtaining generation parameters. As an example, such input controls may include a prompt word input control, a parameter map setting control 505, a model selection control, a frame setting control, and the like.

[0074] In some embodiments, the electronic device 110 may acquire at least one reference image for generating a picture material or a video material via the reference image setting control 505. As an example, the electronic device 110 may receive a selection of the reference image setting control 505 and may present a picture acquisition interface for acquiring a reference image uploaded or taken by a user.

[0075] In some embodiments, the electronic device 110 may, for example, support a user to add multiple reference pictures. As an example, the electronic device 110 may determine the type of reference information corresponding to each reference picture based on a configuration operation of the user.

[0076] As an example, the type of reference information may include a plurality of preset types, and the user may select a type corresponding to each reference picture from the plurality of preset types.

[0077] In some embodiments, the type of reference information may include a first type, wherein the first type may indicate that the material is generated based on the composition information of the corresponding reference picture. For example, the composition information indicates the picture layout of the reference picture, such as the position of a specific object in the picture, the position relationship of multiple objects in the picture, etc. As an example, the outline information and depth of field information of the reference picture may be extracted to characterize the composition information of the reference picture.

[0078] In some embodiments, the type of reference information may further include a second type, wherein the second type indicates that the first material is generated based on scene information of the corresponding reference picture. For example, the scene information indicates a background picture of at least one reference picture, and such a background picture may be retained, for example. As an example, a background area in a reference picture may be determined by a segmentation model and provided to a material generation model for generating the first material.

[0079] In some embodiments, the types of reference information may also include, but are not limited to: subject information, outline information, picture style information, posture information, depth of field information, etc.

[0080] In some embodiments, the electronic device 110 may also support adding multiple reference pictures. In some scenarios, the multiple reference pictures correspond to the same type of reference information. Alternatively, the multiple reference pictures may correspond to different types of reference information.

[0081] In some scenarios, some types of reference information are not allowed to be added at the same time, for example. On the contrary, some types of reference information are allowed to be added at the same time as different control signals for controlling material generation.

[0082] like Figure 5 As shown, after the corresponding reference pictures are added, the electronic device 110 may display a label 510 corresponding to each reference picture, and such a label 510 may indicate the type of reference information corresponding to each reference picture. Figure 5 As an example, the user may configure three reference pictures, and the types of reference information corresponding to the three reference pictures are: subject information, composition information, and scene information, respectively.

[0083] In some embodiments, the user can also quickly delete a reference picture, replace a reference picture, or change the type of reference information by, for example, editing tag 510 .

[0084] It should be understood that such reference information can be provided to the material generation model as a control signal to control the material generation process.

[0085] Based on this approach, the embodiments of the present disclosure can further improve the quality of material generation, thereby improving the efficiency of media editing.

[0086] Example Process

[0087] Figure 6 600 is a flowchart of an example process 600 for media editing according to some embodiments of the present disclosure. The process 600 may be implemented at the electronic device 110. Figure 1 600 is described below.

[0088] As shown in the figure, in box 610, the electronic device 110 presents a media editing interface, the media editing interface includes an editing track, and the editing track presents at least one material.

[0089] At block 620 , the electronic device 110 provides a first generated entry associated with the editing track in the editing interface.

[0090] In block 630 , in response to the selection of the first generation entry, the electronic device 110 presents a material generation window, where the material generation window is used to obtain at least one generation parameter.

[0091] In block 640 , the electronic device 110 adds the first material generated based on at least one generation parameter in the editing track, wherein an insertion position of the first material in the editing track is determined based on a target position of the indicator in the editing track.

[0092] In some embodiments, adding a first material generated based on at least one generation parameter in the editing track includes: in response to the indicator being located within a second material in the at least one material, splitting the second material based on a target position of the indicator; and inserting the generated first material at the split position.

[0093] In some embodiments, adding a first material generated based on at least one generation parameter to an editing track includes: in response to an indicator being located within a third material in at least one material, determining a relative position relationship between the indicator and the third material based on a target position of the indicator; determining an insertion position of the first material based on the relative position relationship, the insertion position being before the third material or after the third material; and inserting the generated first material at the insertion position.

[0094] In some embodiments, the process 600 further includes: receiving a selection of a target material among the at least one material; and presenting a second generation entry associated with the target material, the type of the second generation entry being determined based on the attribute information of the target material.

[0095] In some embodiments, presenting a second generation entry associated with the target material includes: in response to the target material being a picture material, determining whether the picture material is generated using a picture generation component; in response to the picture material being generated using a picture generation component, presenting a picture generation entry and / or a video generation entry associated with the picture material.

[0096] In some embodiments, the process 600 further includes: in response to the selection of the picture generation portal, presenting a set of historical picture materials associated with the picture material, the set of historical picture materials being generated by using the picture generation component.

[0097] In some embodiments, process 600 further includes: in response to selecting a video generation portal, determining whether the picture material is used to generate a historical video material; and in response to the picture material being used to generate a group of historical video materials, presenting a group of historical video materials in a material selection window.

[0098] In some embodiments, process 600 further includes: in response to the picture material not being used to generate the historical video material, presenting a first video generation window, the first video generation window being configured to generate the video material based on the picture material.

[0099] In some embodiments, process 600 also includes: in response to the picture material not being generated using the picture generation component, presenting a video generation entry associated with the picture material; and in response to selecting the video generation entry, presenting a second video generation window, the second video generation window being configured to generate video material based on the picture material.

[0100] In some embodiments, presenting a second generation entry associated with the target material includes: in response to the target material being video material, determining whether the video material is generated using a video generation component; in response to the video material being generated using a video generation component, presenting a video generation entry associated with the video material, the video generation entry being configured to trigger presentation of a set of historical video materials generated by the video generation component.

[0101] In some embodiments, process 600 further includes: in response to whether the picture based on the video material is generated using a picture generation component, presenting a picture generation entry associated with the video material, wherein the picture generation entry is configured to trigger presentation of a set of historical pictures generated by the picture generation component.

[0102] In some embodiments, the process 600 further includes: providing a reference picture setting control in the material generation window; and acquiring at least one reference picture for generating the first material via the reference picture setting control.

[0103] In some embodiments, the at least one reference picture includes a plurality of reference pictures, the plurality of reference pictures corresponding to the same type of reference information or different types of reference information.

[0104] In some embodiments, process 600 further includes determining, via a reference picture settings control, a type of reference information corresponding to the at least one reference picture.

[0105] In some embodiments, the type includes a first type indicating that the first material is generated based on composition information of at least one reference picture.

[0106] In some embodiments, the types include a second type indicating that the first material is generated based on scene information of at least one reference picture.

[0107] Example devices and equipment

[0108] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 7 A schematic structural block diagram of an example apparatus 700 for media editing according to some embodiments of the present disclosure is shown. The apparatus 700 may be implemented as or included in the electronic device 110. Each module / component in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0109] like Figure 7As shown, the device 700 includes a presentation module 710, which is configured to present a media editing interface, the media editing interface includes an editing track, and the editing track presents at least one material; a providing module 720, which is configured to provide a first generation entry associated with the editing track in the editing interface; an acquisition module 730, which is configured to present a material generation window in response to a selection of the first generation entry, the material generation window is used to obtain at least one generation parameter; and an adding module 740, which is configured to add a first material generated based on at least one generation parameter in the editing track, wherein the insertion position of the first material in the editing track is determined based on the target position of the indicator in the editing track.

[0110] In some embodiments, the presentation module 710 is further configured to: in response to the indicator being located within a second material of the at least one material, segment the second material based on a target position of the indicator; and insert the generated first material at the segmentation position.

[0111] In some embodiments, the adding module 740 is also configured to: in response to the indicator being located within a third material in at least one material, determine the relative position relationship between the indicator and the third material based on the target position of the indicator; determine the insertion position of the first material based on the relative position relationship, the insertion position being before the third material or after the third material; and insert the generated first material at the insertion position.

[0112] In some embodiments, the device 700 also includes a first receiving module configured to receive a selection of a target material among the at least one material; and present a second generation entry associated with the target material, wherein a type of the second generation entry is determined based on attribute information of the target material.

[0113] In some embodiments, the first receiving module is further configured to: in response to the target material being a picture material, determine whether the picture material is generated using a picture generation component; in response to the picture material being generated using a picture generation component, present a picture generation entry and / or a video generation entry associated with the picture material.

[0114] In some embodiments, the device 700 further includes a material presentation module configured to present a group of historical picture materials associated with the picture material in response to selection of the picture generation entry, wherein the group of historical picture materials is generated by using the picture generation component.

[0115] In some embodiments, the device 700 also includes a first determination module, which is configured to determine whether the picture material is used to generate historical video material in response to selection of a video generation entrance; and in response to the picture material being used to generate a group of historical video materials, present a group of historical video materials in the material selection window.

[0116] In some embodiments, the device 700 further includes a window presentation module configured to present a first video generation window in response to the picture material not being used to generate the historical video material, wherein the first video generation window is configured to generate the video material based on the picture material.

[0117] In some embodiments, the device 700 also includes a first entry presentation module, which is configured to present a video generation entry associated with the picture material in response to the picture material not being generated using the picture generation component; and in response to the selection of the video generation entry, present a second video generation window, and the second video generation window is configured to generate video material based on the picture material.

[0118] In some embodiments, the first receiving module is further configured to: in response to the target material being video material, determine whether the video material is generated using a video generation component; in response to the video material being generated using a video generation component, present a video generation entry associated with the video material, and the video generation entry is configured to trigger the presentation of a set of historical video materials generated by the video generation component.

[0119] In some embodiments, the device 700 also includes a second entry presentation module, which is configured to present a picture generation entry associated with the video material in response to whether the picture on which the video material is based is generated using a picture generation component, and the picture generation entry is configured to trigger the presentation of a set of historical pictures generated by the picture generation component.

[0120] In some embodiments, the apparatus 700 further includes a control providing module configured to provide a reference picture setting control in the material generation window; and obtain at least one reference picture for generating the first material via the reference picture setting control.

[0121] In some embodiments, the at least one reference picture includes a plurality of reference pictures, the plurality of reference pictures corresponding to the same type of reference information or different types of reference information.

[0122] In some embodiments, the apparatus 700 further comprises a second determining module configured to determine, via a reference picture setting control, a type of reference information corresponding to the at least one reference picture.

[0123] In some embodiments, the type includes a first type indicating that the first material is generated based on composition information of at least one reference picture.

[0124] In some embodiments, the types include a second type indicating that the first material is generated based on scene information of at least one reference picture.

[0125] The modules included in the device 700 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the modules in the device 700 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0126] Figure 8 8 is a block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 8 The electronic device 800 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 8 The electronic device 800 shown can be used to implement Figure 1 An electronic device 110.

[0127] like Figure 8 As shown, the electronic device 800 is in the form of a general electronic device. The components of the electronic device 800 may include, but are not limited to, one or more processors or processing units 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 820. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 800.

[0128] The electronic device 800 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 800.

[0129] The electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 8 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0130] The communication unit 840 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 800 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0131] The input device 850 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 860 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 800 may also communicate with one or more external devices (not shown) through the communication unit 840 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 800, or communicate with any device that allows the electronic device 800 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0132] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0133] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0134] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0135] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0136] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0137] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for media editing, comprising: Presenting a media editing interface, the media editing interface comprising an editing track, the editing track presenting at least one material; providing a first generation entry associated with the editing track in the editing interface; In response to the selection of the first generation entry, presenting a material generation window, wherein the material generation window is used to obtain at least one generation parameter; as well as A first material generated based on the at least one generation parameter is added to the editing track, wherein an insertion position of the first material in the editing track is determined based on a target position of an indicator in the editing track.

2. The method according to claim 1, wherein adding the first material generated based on the at least one generation parameter to the editing track comprises: In response to the indicator being located within a second material of the at least one material, segmenting the second material based on the target position of the indicator; as well as The generated first material is inserted at the division position.

3. The method according to claim 1, wherein adding the first material generated based on the at least one generation parameter to the editing track comprises: In response to the indicator being located in a third material of the at least one material, determining a relative positional relationship between the indicator and the third material based on the target position of the indicator; Based on the relative position relationship, determining the insertion position of the first material, the insertion position being before the third material or after the third material; as well as The generated first material is inserted at the insertion position.

4. The method according to claim 1, further comprising: receiving a selection of a target material among the at least one material; as well as A second generation entry associated with the target material is presented, wherein a type of the second generation entry is determined based on attribute information of the target material.

5. The method of claim 4, wherein presenting a second generated entry associated with the target material comprises: In response to the target material being a picture material, determining whether the picture material is generated using a picture generation component; In response to the picture material being generated by using the picture generation component, a picture generation entry and / or a video generation entry associated with the picture material is presented.

6. The method according to claim 5, further comprising: In response to selection of the picture generation entry, a group of historical picture materials associated with the picture material is presented, and the group of historical picture materials is generated by using the picture generation component.

7. The method according to claim 5, further comprising: In response to the selection of the video generation entry, determining whether the picture material is used to generate historical video material; as well as In response to the picture material being used to generate a group of historical video materials, the group of historical video materials is presented in a material selection window.

8. The method according to claim 7, further comprising: In response to the picture material not being used to generate the historical video material, a first video generation window is presented, wherein the first video generation window is configured to generate the video material based on the picture material.

9. The method according to claim 5, further comprising: In response to the picture material not being generated by the picture generation component, presenting a video generation entry associated with the picture material; as well as In response to selection of the video generation entry, a second video generation window is presented, wherein the second video generation window is configured to generate video material based on the picture material.

10. The method of claim 4, wherein presenting a second generated entry associated with the target material comprises: In response to the target material being a video material, determining whether the video material is generated using a video generation component; In response to the video material being generated by the video generation component, a video generation portal associated with the video material is presented, wherein the video generation portal is configured to trigger presentation of a set of historical video materials generated by the video generation component.

11. The method according to claim 10, further comprising: In response to whether the picture based on the video material is generated by using a picture generation component, a picture generation entry associated with the video material is presented, and the picture generation entry is configured to trigger presentation of a group of historical pictures generated by the picture generation component.

12. The method according to claim 1, further comprising: Providing a reference image setting control in the material generation window; as well as At least one reference picture for generating the first material is obtained via the reference picture setting control. 13 . The method of claim 12 , wherein the at least one reference picture comprises a plurality of reference pictures, the plurality of reference pictures corresponding to the same type of reference information or different types of reference information.

14. The method according to claim 12, further comprising: Via the reference picture setting control, a type of reference information corresponding to the at least one reference picture is determined. 15 . The method of claim 14 , wherein the types include a first type indicating that the first material is generated based on composition information of the at least one reference picture. 16 . The method of claim 14 , wherein the types include a second type indicating that the first material is generated based on scene information of the at least one reference picture.

17. An apparatus for media editing, comprising: A presentation module, configured to present a media editing interface, wherein the media editing interface includes an editing track, and the editing track presents at least one material; A providing module is configured to provide a first generation entry associated with the editing track in the editing interface; an acquisition module, configured to present a material generation window in response to selection of the first generation entry, wherein the material generation window is used to acquire at least one generation parameter; as well as The adding module is configured to add a first material generated based on the at least one generating parameter in the editing track, wherein an inserting position of the first material in the editing track is determined based on a target position of an indicator in the editing track.

18. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.

19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1 to 16 when executed by a processor.

Images