Media editing method and apparatus, and device and storage medium

Abstract

A media editing method and apparatus, and a device and a storage medium. The method comprises: on the basis of input information received in a generation component of an editing interface, providing, in the editing interface, a group of candidate media items generated on the basis of the input information; on the basis of a first operation for at least one media item among the group of candidate media items, adding the selected at least one media item to a material component of the editing interface, and using same as a candidate material; receiving a request for applying a first material in the material component to a first fragment of a track component, and generating first media content corresponding to the first fragment, wherein the track component displays at least one fragment for editing; and generating a media editing result at least on the basis of the first media content.

Description

Media editing method, device, equipment and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202410479926.7, filed on April 19, 2024, entitled “Media editing method, device, equipment and storage medium”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The example embodiments of the present disclosure generally relate to the field of computer, in particular, to a media editing method, device, equipment and computer readable storage medium. BACKGROUND

[0003] With the rapid development of intelligence, various forms of electronic devices can greatly enrich people's daily life. For example, a user can perform media editing based on some electronic devices to generate a media editing result. The form of the media editing result includes, for example but not limited to, a picture, an audio, a video, a text, and the like. How to efficiently generate a media editing result that meets the user's needs is a focus problem. SUMMARY

[0004] In a first aspect of the present disclosure, a media editing method is provided. The method comprises: providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; adding, in a material component of the editing interface, at least one selected media item in the set of candidate media items as a candidate material based on a first operation on the at least one selected media item; receiving a request to apply a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing; and generating a media editing result based at least on a first media content corresponding to the first segment.

[0005] In a second aspect of the present disclosure, a device for media editing is provided. The device comprises: a first providing module configured to provide, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; a first adding module configured to add, in a material component of the editing interface, at least one selected media item in the set of candidate media items as a candidate material based on a first operation on the at least one selected media item; a first generating module configured to receive a request to apply a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing; and a second generating module configured to generate a media editing result based at least on a first media content corresponding to the first segment.

[0006] In a third aspect of the disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, which is executable by a processor to implement the method of the first aspect.

[0008] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the disclosure or the present disclosure. Other features, aspects, and advantages of the disclosure will become apparent from the following description, which is given by way of example only, with reference to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0009] The above and other features, aspects, and advantages of embodiments of the disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numerals represent like elements throughout the drawings, wherein:

[0010] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the disclosure can be implemented;

[0011] FIGS. 2A-2D show interface diagrams, according to some embodiments of the disclosure;

[0012] FIG. 3 shows a flowchart of a process of media editing, according to some embodiments of the disclosure;

[0013] FIG. 4 shows a schematic block diagram of an apparatus for media editing, according to certain embodiments of the disclosure;

[0014] FIG. 5 shows a block diagram of an electronic device that can implement various embodiments of the disclosure. DETAILED DESCRIPTION

[0015] Embodiments of the disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which some embodiments of the disclosure are shown. This disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the disclosure to those skilled in the art.

[0016] It should be noted that the headings provided in any section / subsection of the disclosure herein are not limitations. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiments described in the same section / subsection and / or different section / subsection in any manner.

[0017] In the description of embodiments of the disclosure, the term "includes" and its derivatives, such as "including," should be understood in an open, inclusive sense, that is, "including, but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "an embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicitly and implicitly recited definitions can also be found in the following text. The terms "first," "second," etc. can refer to different or the same objects. Other explicit and implicit definitions can also be found in the following text.

[0018] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, when implementing embodiments of the disclosure, the type of data or information that can be involved, the scope of use, the scenario of use, etc. should be informed to the user and the authorization of the user should be obtained in a proper manner according to relevant laws and regulations. The specific informing and / or authorization manner can vary according to actual situations and application scenarios, and the scope of the disclosure is not limited in this aspect.

[0019] In the description of the specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the scope of the provisions or agreement. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0020] As discussed above, personal information pages have become an important way for people to learn about a particular user. A user may, for example, also manage the information presented to visitors by configuring a personal information page. For example, a user can set a corresponding image background for a personal information page. However, conventional schemes typically provide the same viewing permissions for different types of visitors regarding a media display area (e.g., a background area) in a personal information page, which can not be desirable for a user.

[0021] Embodiments of the present disclosure propose a media editing scheme. According to the scheme, a set of candidate media items generated based on input information received in a generation component of an editing interface can be provided in the editing interface; further, based on a first operation on at least one media item in the set of candidate media items, the selected at least one media item can be added in a material component of the editing interface as a candidate material; further, a request of applying a first material in the material component to a first segment of a track component can be received, the track component displays at least one segment for editing; finally, a media editing result can be generated based at least on a first media content corresponding to the first segment.

[0022] Thus, embodiments of the present disclosure can provide a convenient media editing page, and can realize media content generation and media content editing integration, and improve the efficiency of media editing.

[0023] Example Environment

[0024] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.

[0025] In this example environment 100, the electronic device 110 has an application 120 installed therein. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices. The application 120 can be a media editing application, or the like, or any other suitable application.

[0026] In the environment 100 of FIG. 1, if the application 120 is in an active state, the application 120 can provide a presentation interface 150 for the user 140. The user 140 can perform media editing operations based on the interface 150.

[0027] In some embodiments, the electronic device 110 communicates with a server 130 to implement the provision of services to the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media player, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface to a user (such as "wearable" circuitry, etc.).

[0028] The server 130 can be a standalone physical server, a server cluster composed of multiple physical servers, or a distributed system, and can also be a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 can include, for example, a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports content presentation.

[0029] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a universal serial bus connection, a wireless fidelity connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can achieve signaling interaction through the communication connection therebetween.

[0030] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0031] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0032] Example Interaction

[0033] An example interaction process according to embodiments of the present disclosure will be described below with reference to FIGS. 2A-2D. FIGS. 2A-2D illustrate example interfaces 200A-200D, which can be provided by the electronic device 110 shown in FIG. 1, for example, according to some embodiments of the present disclosure.

[0034] As shown in FIG. 2A, the electronic device 110 can present an editing interface 200A as shown in FIG. 2A based on a user request for editing or creating media content. As shown in FIG. 2, the interface 200A can include a generation component 210.

[0035] In some embodiments, the generation component 210 can be used to generate different types of media items, such as picture content or video content. As shown in FIG. 2A, in a picture content generation mode, the generation component 210 can include an input control 213 for inputting a prompt item.

[0036] In some embodiments, the electronic device 110 can generate a set of media items 221, such as multiple pictures, based on the input information obtained in the generation component 210, such as the prompt item obtained via the input control 213.

[0037] In some embodiments, the electronic device 110 may, for example, present the generated set of media items 221 in the generation window 220 of the editing interface 200A. Additionally, the electronic device 110 may, for example, also provide a re-generation entry (e.g., a “Generate Again” button) in association with the set of media items 221 for triggering a re-generation. Upon receiving a selection of the re-generation entry, the electronic device 110 may, for example, generate a new set of media items based on the same input information (e.g., the same prompt items).

[0038] Additionally, the electronic device 110 may, for example, also provide a re-editing entry (e.g., a “Re-edit” button) in association with the set of media items 221 for triggering a re-editing. Upon receiving a selection of the re-editing entry, the electronic device 110 may, for example, populate the generation component 210 with the input information, such as displaying the prompt items corresponding to the set of media items 221 in the input control 213, to support further editing of the prompt items by the user.

[0039] In some embodiments, the electronic device 110 may, for example, provide an add control 223 in association with the media item 221. Specifically, upon receiving a selection of the add control 223, the electronic device 110 may, for example, add the media item 221 to a material component 230 in the editing interface 200A. As an example, such a material component 230 may, for example, present various types of media items that can be used for subsequent clip editing, such as picture content or video content. In some embodiments, such materials may, for example, also be referred to as shot materials.

[0040] As shown in FIG. 2A, the electronic device 110 may, for example, receive a user’s application request for a material (e.g., the media item 221) provided in the material component 230. Specifically, the electronic device 110 may, for example, provide a corresponding use entry 231 in association with the material (e.g., the media item 221). Further, the electronic device 110 may, for example, receive a user’s selection of the use entry 231 to apply the material (e.g., the media item 221) to a current clip.

[0041] Further, as shown in FIG. 2A, the editing interface 200A may, for example, also include a track component 240. The track component 240 may, for example, present a plurality of clips for editing. Such a plurality of clips may, for example, include clips that already have corresponding media content, or may, for example, also include blank clips. In some embodiments, such clips may, for example, also be referred to as “shots”.

[0042] In some embodiments, the electronic device 110 can receive a user selection of the segment 241 and determine the segment 241 as a target segment to be edited currently. Further, upon receiving an application request for a media item (e.g., the media item 221), the electronic device 110 can apply the media item 221 to the segment 241 and accordingly generate a media content 242 corresponding to the segment 241.

[0043] In some embodiments, such a media content may, for example, include a media content (e.g., a video content) with a preset time length. For example, when the applied media item is of a first type (e.g., a picture media item), the electronic device 110 can generate a video content with a preset time length based on the picture media item.

[0044] In some embodiments, the time length of such a media content may, for example, also be determined based on the selected media item (e.g., the media item 221). Specifically, when the applied media item is of a second type (e.g., a video media item), the electronic device 110 can generate a video content with a corresponding time length based on the time length of the video media item. For example, the media content can include only the selected video media item, or can include a combination of the video media item and other segments (e.g., a transition effect).

[0045] In some embodiments, as shown in FIG. 2A, the electronic device 110 can also provide a corresponding usage entry 222 in association with the media item 221. Upon receiving a selection of the usage entry 222, the electronic device 110 can apply the media item 221 to a current segment (e.g., the segment 241) and can accordingly generate a media content 242 corresponding to the segment 241 based on the media item 221.

[0046] In some embodiments, the electronic device 110 can also add the media item 221 to the media item component 230 for subsequent usage or management based on the selection of the usage entry 222.

[0047] As shown in FIG. 2A, the electronic device 110 can also provide an adding entry (e.g., a “+” button) in the track component 240. Upon receiving a selection of the adding entry, the electronic device 110 can accordingly create a new empty segment (or, an empty shot) in the track component 240 for editing.

[0048] In some embodiments, the electronic device 110 can also adjust the position of the segment 221 in the track component based on an adjustment request. For example, the electronic device 110 can adjust the segment 241 to other positions based on a drag operation of the segment 241. Accordingly, the electronic device 110 can associate the generated media content 242 to a time period corresponding to the adjusted position.

[0049] Based on the above described manners, embodiments of the present disclosure can support generating corresponding media content in the editing interface, and can add as material available for segment editing. Accordingly, embodiments of the present disclosure can also implement editing for the segment based on the added material to generate corresponding video content. In this way, embodiments of the present disclosure can provide efficiency for media editing.

[0050] FIG. 2B illustrates an example interface 200B according to some embodiments of the present disclosure. As shown in FIG. 2B, the generation component 210 may, for example, also support generation of video content. Specifically, the electronic device 110 may, for example, determine to use a picture generation mode or a video generation mode based on selection of an entry 211 or an entry 212.

[0051] In some embodiments, as shown in FIG. 2B, in the video generation mode, the electronic device 110 may, for example, provide different generation modes in the generation component 210, such as a picture-based generation mode 214 and a text-based generation mode 215.

[0052] As an example, in a case where the text-based generation mode 215 is selected, the electronic device 110 may, for example, acquire prompt items similar to FIG. 2A, and provide video content generated based on the prompt items.

[0053] On the contrary, in a case where the picture-based generation mode 214 is selected, the electronic device 110 may, for example, provide an image selection control 216 in the generation component 210, and may, for example, acquire a reference image for video content generation based on the image selection control 216.

[0054] In some embodiments, the electronic device 110 may, for example, support a user to acquire a reference image by uploading an existing image. In another embodiments, in a case where “use tail frame” is turned on, the reference image may, for example, be determined automatically as determined by the media content 242 corresponding to the previous segment 241 of the current segment 243. For example, the reference image may, for example, be determined as the last frame image of the media content 242.

[0055] In yet some embodiments, the electronic device 110 may, for example, also support a user to generate a new media item based on selection of an existing material. As shown in FIG. 2C, the electronic device 110 may, for example, provide a generation entry 232 for generating a video in association with a material (e.g., a media item 221).

[0056] In some embodiments, in a case where selection of the generation entry 232 is received, the electronic device 110 may, for example, determine the media item 221 as a reference image, and may, for example, display the reference image in the image selection control 216 of the generation component.

[0057] Further, as shown in FIG. 2C, the electronic device 110 can also provide an input control 217 for inputting the prompt item. Further, the electronic device 110 can generate the corresponding video content 224 based on the reference image (e.g., the media item 221, or a user-uploaded image, or the last frame image of the previous segment) and the received prompt item.

[0058] Further, the electronic device 110 can support the user to add the video content 224 as new material, or directly apply to the current segment, e.g., the segment 243, to generate the corresponding media content 244, based on the above-described process.

[0059] Additionally, the electronic device 110 can also provide a re-generation entry for triggering re-generation in association with the material (e.g., the media item 221) in the material component 230. Upon receiving a selection of the re-generation entry, the electronic device 110 can generate a new set of media items based on the same input information (e.g., the same prompt item).

[0060] Additionally, the electronic device 110 can also provide a re-editing entry 233 for triggering re-editing in association with the material (e.g., the media item 221) in the material component 230. Upon receiving a selection of the re-editing entry 233, the electronic device 110 can populate the generation component 210 with the input information, e.g., display the prompt item corresponding to the set of media items 221 in the input control 213, to support further editing of the prompt item by the user.

[0061] Additionally, the electronic device 110 can also provide an entry 234 for deleting the material in association with the material (e.g., the media item 221) in the material component, for example.

[0062] As shown in FIG. 2C, the electronic device 110 can also provide a control 245 in the interface 200C. Upon receiving a selection of the control 245, the electronic device 110 can present the description information corresponding to the added segments (e.g., the segment 241, the segment 243), etc. in the track component 240. In some embodiments, such description information can include the length of the shot, the scene information of the shot, etc.

[0063] In some embodiments, the electronic device 110 can also provide a control 246. In some embodiments, the electronic device 110 can receive an audio generation request based on a selection of the control 246, and can accordingly present an audio generation component (not shown in the figure).

[0064] Specifically, the electronic device 110 can acquire corresponding configuration information based on the audio generation component, and generate audio content corresponding to the segments 241 and / or 243 based on the configuration information.

[0065] In some embodiments, such audio content may, for example, include narration content corresponding to each segment. In some embodiments, the acquired configuration information may, for example, include timbre information about the narration content, scripts of the narration content, prompt items for generating the narration content, and the like.

[0066] In some embodiments, the electronic device 110 can also provide a control 247. The electronic device 110 can receive a script editing request based on selection of the control 247.

[0067] Exemplarily, the electronic device 110 can present a script editing window 200D as shown in FIG. 2D based on the received script editing request. In the script editing window, the electronic device 110 can support the user to edit and manage each segment by editing the script.

[0068] In some embodiments, the electronic device 110 can display a set of input controls corresponding to the at least one segment in the script editing window 2200D. In some embodiments, the set of input controls includes at least one of: a first input control 250 for inputting scene description content; a second input control 251 for inputting shot description content; and a third input control 252 for inputting dialogue content.

[0069] Additionally, the electronic device 110 can also provide media content corresponding to each segment (or shot) in each scene, for example, media content 242.

[0070] In this way, embodiments of the present disclosure can support the user to further edit the editing result in the editing interface by script editing, thereby improving the efficiency of editing.

[0071] Based on the above-described process, embodiments of the present disclosure can provide a convenient media editing page, can realize media content generation and media content editing integration, and improve the efficiency of media editing.

[0072] Example process

[0073] FIG. 3 shows a flowchart of a media editing process 300 according to some embodiments of the present disclosure. The process 300 can be implemented at the electronic device 110. The process 300 is described below with reference to FIG. 1.

[0074] At block 310, the electronic device 110 provides, in the editing interface, a set of candidate media items generated based on the input information received in the generation component of the editing interface.

[0075] At block 320, the electronic device 110 adds, in the material component of the editing interface, at least one media item selected from the set of candidate media items as candidate material based on a first operation on the at least one media item.

[0076] At block 330, the electronic device 110 receives a request to apply the first material in the material component to a first segment of a track component, generates first media content corresponding to the first segment, and the track component displays at least one segment for editing.

[0077] At block 340, the electronic device 110 generates a media editing result based at least on the first media content.

[0078] In some embodiments, providing, in the editing interface, a set of candidate media items generated based on the input information received in the generation component of the editing interface comprises: determining a prompt based on the input information received in the generation component; and providing, in the editing interface, a set of candidate media items generated based on the prompt.

[0079] In some embodiments, the generation component further comprises an image selection control, and the set of candidate media items is further generated based on a reference image determined via the image selection control.

[0080] In some embodiments, the reference image comprises at least one of: a first image determined based on a preset operation on a second material in the material component; a second image determined based on an image upload operation; and a third image determined based on second media content corresponding to a second segment preceding the first segment in the track component.

[0081] In some embodiments, the process 300 further comprises: based on a second operation on at least one media item in the set of candidate media items, applying the at least one media item to a current segment in the track component to generate third media content corresponding to the current segment; and adding the at least one media item to the material component as candidate material.

[0082] In some embodiments, the set of media items is a first set of media items, and the process 300 further comprises: receiving a regeneration request associated with the input information; and providing, in the editing interface, a second set of media items generated based on the input information.

[0083] In some embodiments, receiving the regeneration request associated with the input information comprises: receiving a selection of a first regeneration portal, the first regeneration portal being associated with the first set of media items; or receiving a selection of a second regeneration portal, the second regeneration portal being associated with at least one media item added in the material component.

[0084] In some embodiments, the process 300 further comprises: receiving an editing request associated with the input information; and populating the generation component based on the input information.

[0085] In some embodiments, receiving the editing request associated with the input information comprises: receiving a selection of a first editing portal, the first editing portal being associated with a set of media items; or receiving a selection of a second editing portal, the second editing portal being associated with at least one media item added in the material component.

[0086] In some embodiments, the process 300 further comprises: receiving a selection of an addition portal in the track component; and adding an empty segment for editing in the track component.

[0087] In some embodiments, in response to the first material being of a first type, the first media content is generated based on a preset time length; and / or in response to the first material being of a second type, the first media content is generated based on a time length of the first material.

[0088] In some embodiments, the process 300 further comprises: presenting an audio generation component based on an audio generation request for the first media content; and generating target audio content corresponding to the first media content based on configuration information obtained via the audio generation component.

[0089] In some embodiments, the process 300 further comprises: presenting a script editing window corresponding to the media editing result based on the received script editing request; and displaying a set of input controls corresponding to the at least one segment in the script editing window.

[0090] In some embodiments, the set of input controls comprises at least one of: a first input control for inputting scene description content; a second input control for inputting shot description content; a third input control for inputting dialogue content.

[0091] In some embodiments, the process 300 further comprises: presenting the first media content corresponding to the first segment in the script editing window.

[0092] In some embodiments, the process 300 further comprises: associating the first media content to a time period corresponding to an adjusted position of the first segment in the track component based on an adjustment request to adjust the position of the first segment in the track component.

[0093] Example apparatus and device

[0094] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 4 shows a schematic structural block diagram of an apparatus 400 for media editing according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in the electronic device 110 as discussed above. Various modules / components in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0095] As shown in FIG. 4, the apparatus 400 includes a first providing module 410 configured to provide, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; a first adding module 420 configured to add, in a material component of the editing interface, at least one media item selected from the set of candidate media items as candidate material based on a first operation on the at least one media item; a first generating module 430 configured to receive a request to apply first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing, and generate first media content corresponding to the first segment; and a second generating module 440 configured to generate a media editing result based at least on the first media content.

[0096] In some embodiments, the first providing module 410 is specifically configured to determine a prompt item based on the input information received by the generation component, and provide, in the editing interface, the set of candidate media items generated based on the prompt item.

[0097] In some embodiments, the generation component further includes an image selection control, and the set of candidate media items is further generated based on a reference image determined via the image selection control.

[0098] In some embodiments, the reference image includes at least one of: a first image determined based on a preset operation on second material in the material component; a second image determined based on an image upload operation; and a third image determined based on second media content corresponding to a second segment preceding the first segment in the track component.

[0099] In some embodiments, the apparatus 400 further includes a third generating module configured to apply, based on a second operation on at least one media item in the set of candidate media items, the at least one media item to a current segment in the track component to generate third media content corresponding to the current segment; and a second adding module configured to add the at least one media item to the material component as candidate material.

[0100] In some embodiments, the set of media items is a first set of media items, the apparatus 400 further includes a first receiving module configured to receive a regeneration request associated with the input information; and a second providing module configured to provide, in the editing interface, a second set of media items generated based on the input information.

[0101] In some embodiments, the first receiving module is specifically configured to receive a selection of a first regeneration entry associated with the first set of media items, or receive a selection of a second regeneration entry associated with at least one media item added in the material component.

[0102] In some embodiments, the apparatus 400 further includes a second receiving module configured to receive a re-editing request associated with the input information; and a filling module configured to fill the generation component based on the input information.

[0103] In some embodiments, the second receiving module is specifically configured to receive a selection of a first re-editing entry associated with the set of media items, or receive a selection of a second re-editing entry associated with at least one media item added in the material component.

[0104] In some embodiments, the apparatus 400 further includes a third receiving module configured to receive a selection of an adding entry in the track component; and a third adding module configured to add an empty clip for editing in the track component.

[0105] In some embodiments, in response to the first material being of a first type, the first media content is generated based on a preset time length; and / or in response to the first material being of a second type, the first media content is generated based on a time length of the first material.

[0106] In some embodiments, the apparatus 400 further includes a first presenting module configured to present an audio generation component based on an audio generation request for the first media content; and a fourth generation module configured to generate target audio content corresponding to the first media content based on configuration information obtained via the audio generation component.

[0107] In some embodiments, the apparatus 400 further includes a second presenting module configured to present a script editing window corresponding to the media editing result based on the received script editing request; and a display module configured to display a set of input controls corresponding to at least one clip in the script editing window.

[0108] In some embodiments, the set of input controls includes at least one of: a first input control for inputting scene description content; a second input control for inputting shot description content; a third input control for inputting dialogue content.

[0109] In some embodiments, the apparatus 400 further includes a third presentation module configured to present the first media content corresponding to the first scene in the script editing window.

[0110] In some embodiments, the apparatus 400 further includes an association module configured to associate the first media content to a time period corresponding to the adjusted position of the first scene based on an adjustment request to adjust the position of the first scene in the track component.

[0111] The units included in the apparatus 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units in the apparatus 400 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.

[0112] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely an example and should not be construed to limit the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the electronic device 110 illustrated in FIG. 1.

[0113] As shown in FIG. 5, the electronic device 500 is in the form of a general electronic device. Components of the electronic device 500 can include, but are not limited to, one or more processors or processing units 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 520. In a multi-processor system, multiple processing units perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0114] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and nonvolatile media, removable and non-removable media. The memory 520 can be volatile (such as register, cache, RAM), non-volatile (such as ROM, EEPROM, flash memory), or some combination of the two. The storage device 530 can be a removable or non-removable media, and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be used to store information and / or data (e.g., training data for training) and that can be accessed by the electronic device 500.

[0115] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non- volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0116] The communication unit 540 enables communication with other electronic devices over communication media. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communication over a communication connection. Thus, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in the networking environment.

[0117] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 540, as needed, one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0118] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0119] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0120] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0121] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0122] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk drive, or any other suitable non-transitory computer readable medium can store the computer program product.

[0123] Various implementations of the disclosure have been described in detail above. The foregoing description is exemplary and explanatory only, and is not intended to be exhaustive or to limit various implementations of the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings without departing from the scope and spirit of the disclosure. It is intended that the scope of the disclosure be limited only by the claims and the equivalents thereof. The use of the terms "including," "containing," "comprising," "having," "in involving," "portions," "elements," "components," "steps," "phases," "processes," "operations," "steps," "stages," "procedures," "methods," "mechanisms," "devices," "systems," "apparatuses," "units," "means," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "apparatuses," "units," "devices," "systems," "

Claims

1. A media editing method, comprising: providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; adding, in a material component of the editing interface, at least one media item of the set of candidate media items as a candidate material based on a first operation on the at least one media item; receiving a request of applying a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing, generating a first media content corresponding to the first segment; and generating a media editing result based at least on the first media content. 2.The method of claim 1, wherein providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface comprises: determining a prompt item based on the input information received by the generation component; and providing, in the editing interface, the set of candidate media items generated based on the prompt item. 3.The method of claim 2, wherein the generation component further comprises an image selection control, and the set of candidate media items is further generated based on a reference image determined via the image selection control. 4.The method of claim 3, wherein the reference image comprises at least one of: a first image determined based on a preset operation on a second material in the material component; a second image determined based on an image uploading operation; a third image determined based on a second media content corresponding to a second segment preceding the first segment in the track component. 5.The method of claim 1, further comprising: applying, based on a second operation on the at least one media item of the set of candidate media items, the at least one media item to a current segment in the track component to generate a third media content corresponding to the current segment; and adding the at least one media item to the material component as a candidate material. 6.The method of claim 1, wherein the set of media items is a first set of media items, the method further comprising: receiving a re-generation request associated with the input information; and providing, in the editing interface, a second set of media items generated based on the input information. 7.The method of claim 6, wherein receiving a re-generation request associated with the input information comprises: receiving a selection of a first re-generation entry, the first re-generation entry associated with the first set of media items; or receiving a selection of a second re-generation entry, the second re-generation entry associated with the at least one media item added in the material component. 8.The method of claim 1, further comprising: receiving a re-editing request associated with the input information; and populating the generation component based on the input information. 9.The method of claim 8, wherein receiving a re-editing request associated with the input information comprises: ​ ​ ​ ​ ​ receiving a selection of a first re-edit entry, the first re-edit entry being associated with the set of media items; or receiving a selection of a second re-edit entry, the second re-edit entry being associated with the added at least one media item in the material assembly.

10. The method of claim 1, further comprising: receiving a selection of an add entry in the track assembly; and adding an empty segment for editing in the track assembly.

11. The method of claim 1, wherein: in response to the first material being of a first type, generating the first media content based on a preset time length; and / or in response to the first material being of a second type, generating the first media content based on a time length of the first material.

12. The method of claim 1, further comprising: based on an audio generation request for the first media content, presenting an audio generation assembly; and generating target audio content corresponding to the first media content based on configuration information obtained via the audio generation assembly.

13. The method of claim 1, further comprising: based on a received script editing request, presenting a script editing window corresponding to the media editing result; and displaying a set of input controls corresponding to the at least one segment in the script editing window.

14. The method of claim 13, wherein the set of input controls comprises at least one of: a first input control for inputting scene description content; a second input control for inputting shot description content; a third input control for inputting dialogue content.

15. The method of claim 13, further comprising: presenting the first media content corresponding to the first segment in the script editing window.

16. The method of claim 1, further comprising: based on an adjustment request to adjust a position of the first segment in the track assembly, associating the first media content to a time period corresponding to the adjusted position.

17. An apparatus for media editing, comprising: a first providing module configured to provide, in an editing interface, a set of candidate media items generated based on input information received in a generation assembly of the editing interface; a first adding module configured to add, in a material assembly of the editing interface, at least one media item selected from the set of candidate media items as a candidate material based on a first operation on the at least one media item; a first generating module configured to receive a request to apply a first material in the material assembly to a first segment of a track assembly, the track assembly displaying at least one segment for editing, and generate a first media content corresponding to the first segment; and a second generating module configured to generate a media editing result based on at least the first media content.

18. An electronic device, comprising: at least one processing unit; and ​ ​ at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1 to 16.

19. A computer readable storage medium having stored thereon a computer program, the computer program, when executed by a processor, implementing the method according to any one of claims 1 to 16.

Images