Media editing method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a media editing method and device, equipment and a storage medium. The method comprises the following steps: based on input information received in a generation component of an editing interface, providing a group of candidate media items generated based on the input information in the editing interface; based on a first operation on at least one media item in the group of candidate media items, adding the selected at least one media item in a material component of the editing interface as a candidate material; receiving a request for applying a first material in the material component to a first segment of a track component, generating first media content corresponding to the first segment, and displaying at least one segment for editing by the track component; and generating a media editing result at least based on the first media content. According to the embodiment of the invention, the convenient media editing page can be provided, the integration of media content generation and media content editing can be realized, and the media editing efficiency is improved.

Description

TECHNICAL FIELD

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a media editing method, apparatus, device and computer readable storage medium. BACKGROUND

[0002] With the rapid development of intelligence, various forms of electronic devices can greatly enrich people's daily life. For example, a user can perform media editing based on some electronic devices to generate a media editing result. The form of the media editing result includes, for example but not limited to, a picture, an audio, a video, a text, and the like. How to efficiently generate a media editing result that meets the user's needs is a focus problem. SUMMARY

[0003] In a first aspect of the present disclosure, a media editing method is provided. The method comprises: providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; adding, in a material component of the editing interface, at least one selected media item in the set of candidate media items as a candidate material based on a first operation on the at least one selected media item; receiving a request to apply a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing; and generating a media editing result based at least on a first media content corresponding to the first segment.

[0004] In a second aspect of the present disclosure, an apparatus for media editing is provided. The apparatus comprises: a first providing module configured to provide, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; a first adding module configured to add, in a material component of the editing interface, at least one selected media item in the set of candidate media items as a candidate material based on a first operation on the at least one selected media item; a first generating module configured to receive a request to apply a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing; and a second generating module configured to generate a media editing result based at least on a first media content corresponding to the first segment.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer readable storage medium is provided. The computer readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect.

[0007] It should be understood that nothing in the Summary is to be construed as a limitation of the key or important features of embodiments of the disclosure or as limiting the scope of the disclosure. Other features of the disclosure will be more fully understood from the following description of the embodiments, taken with reference to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0008] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numerals denote like elements, and wherein:

[0009] FIG. 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented is shown;

[0010] FIGS. 2A-2D A schematic diagram showing an interface according to some embodiments of the present disclosure is shown;

[0011] FIG. 3 A flowchart showing a process of media editing according to some embodiments of the present disclosure is shown;

[0012] FIG. 4 A schematic block diagram showing an apparatus for media editing according to certain embodiments of the present disclosure is shown;

[0013] FIG. 5 A block diagram of an electronic device capable of implementing a number of embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0014] Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the present disclosure to those skilled in the art. It should be understood that the drawings and embodiments are only for illustrative purposes and are not intended to limit the scope of protection of the present disclosure.

[0015] It should be noted that the headings provided herein are not limitations of the aspects to which they pertain. Various embodiments are described throughout this document and any type of embodiment can be included under any heading. Moreover, embodiments described in any heading can be combined with any other embodiment described in the same heading and / or in a different heading in any manner.

[0016] In the description of embodiments of the disclosure, the term "includes" and its conjugations are to be understood to be open-ended, namely "including but not limited to". The term "based on" is to be understood as "based at least in part on". The term "one embodiment" or "an embodiment" is to be understood as "at least one embodiment". The term "some embodiments" is to be understood as "at least some embodiments". Below, other explicit and implicit definitions can also be included. The terms "first", "second" and the like can refer to different or identical objects. Below, other explicit and implicit definitions can also be included.

[0017] Embodiments of the present disclosure can involve data of users, acquisition and / or use of data, etc. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware and confirms. Accordingly, in the implementation of each embodiment of the present disclosure, the type of data or information that may be involved, the scope of use, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained according to the relevant laws and regulations through appropriate means. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0018] In the present specification and embodiments, if the scheme involves processing of personal information, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0019] As discussed above, personal information pages have become an important way for people to learn about a particular user. A user may, for example, also manage the information presented to visitors by configuring a personal information page. For example, a user can set a corresponding image background for a personal information page. However, conventional schemes typically provide the same viewing permissions for different types of visitors regarding a media display area (e.g., a background area) in a personal information page, which can be undesirable for a user.

[0020] Embodiments of the present disclosure propose a media editing scheme. According to the scheme, a set of candidate media items generated based on input information received in a generation component of an editing interface can be provided in the editing interface; further, based on a first operation on at least one media item in the set of candidate media items, the selected at least one media item can be added in a material component of the editing interface as a candidate material; further, a request of applying a first material in the material component to a first segment of a track component can be received, the track component displays at least one segment for editing; finally, a media editing result can be generated based at least on a first media content corresponding to the first segment.

[0021] Thus, embodiments of the present disclosure can provide a convenient media editing page, and can realize media content generation and media content editing integration, thereby improving the efficiency of media editing.

[0022] Example Environment

[0023] FIG. 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. As shown, the example environment 100 can include an electronic device 110. FIG. 1

[0024] In this example environment 100, the electronic device 110 has an application 120 installed therein. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices. The application 120 can be a media editing application, or any other suitable application.

[0025] In the example environment 100, FIG. 1 If the application 120 is in an active state, the application 120 can provide a presentation interface 150 for the user 140. The user 140 can perform media editing operations based on the interface 150.

[0026] In some embodiments, the electronic device 110 communicates with a server 130 to implement the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media player, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface to the user (such as "wearable" circuitry, etc.).​

[0027] The server 130 can be a standalone physical server, or a server cluster composed of multiple physical servers, or a distributed system, or a cloud server providing cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content distribution network, and basic cloud computing services such as big data and artificial intelligence platform. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports content presentation.

[0028] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a universal serial bus connection, a wireless fidelity connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can achieve signaling interaction through the communication connection therebetween.

[0029] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0030] Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0031] Example Interaction

[0032] An example interaction process according to embodiments of the present disclosure will be described below with reference to FIGS. 2A-2D . FIGS. 2A-2D Example interfaces 200A to 200D according to some embodiments of the present disclosure are shown, which can be provided by the electronic device 110 shown, for example. FIG. 1

[0033] As shown in FIG. 2A , the electronic device 110 can present an editing interface 200A as shown in FIG. 2A based on a user's request for editing or creating media content. As shown in FIG. 2, the interface 200A can include a generation component 210.

[0034] In some embodiments, the generation component 210 can be used to generate different types of media items, such as picture content or video content. As shown in FIG. 2A , in the picture content generation mode, the generation component 210 can include an input control 213 for inputting a prompt item.

[0035] ​In some embodiments, the electronic device 110 may generate a set of media items 221 , such as a plurality of pictures, based on input information obtained in the generation component 210 (eg, prompt items obtained via the input control 213 ).

[0036] In some embodiments, the electronic device 110 may, for example, present the generated set of media items 221 in the generation window 220 of the editing interface 200A. Additionally, the electronic device 110 may also provide a regeneration entry (e.g., a "generate again" button) for triggering regeneration in association with the set of media items 221. Upon receiving a selection of the regeneration entry, the electronic device 110 may generate a new set of media items based on the same input information (e.g., the same prompt item).

[0037] Additionally, the electronic device 110 may also provide a re-editing entry (e.g., a "re-edit" button) for triggering re-editing in association with the group of media items 221. Upon receiving a selection of the re-editing entry, the electronic device 110 may utilize the input information to populate the generation component 210, such as to display a prompt item corresponding to the group of media items 221 in the input control 213, to support the user in further editing the prompt item.

[0038] In some embodiments, the electronic device 110 may, for example, provide an add control 223 associated with the media item 221. Specifically, upon receiving a selection for the add control 223, the electronic device 110 may add the media item 221 to a material component 230 in the editing interface 200A. As an example, such a material component 230 may present various types of media items that can be used for subsequent segment editing, such as image content or video content. In some embodiments, such materials may also be referred to as shot materials.

[0039] like FIG. 2A As shown, the electronic device 110 may receive a user's request to apply a material (e.g., media item 221) provided in the material component 230. Specifically, the electronic device 110 may provide a corresponding usage entry 231 in association with the material (e.g., media item 221). Further, the electronic device 110 may receive a user's selection of the usage entry 231 to apply the material (e.g., media item 221) to the current segment.

[0040] Furthermore, if FIG. 2A As shown, the editing interface 200A may also include a track component 240. The track component 240 may present multiple segments for editing. Such multiple segments may include segments that already have corresponding media content, or may also include blank segments. In some embodiments, such segments may also be referred to as "storyboards," for example.

[0041] In some embodiments, the electronic device 110 can receive a user selection of the segment 241 and determine the segment 241 as a target segment to be edited currently. Further, upon receiving an application request for a media item (e.g., the media item 221), the electronic device 110 can apply the media item 221 to the segment 241 and accordingly generate a media content 242 corresponding to the segment 241.

[0042] In some embodiments, such a media content may, for example, include a media content (e.g., a video content) with a preset time length. For example, when the applied media item is of a first type (e.g., a picture media item), the electronic device 110 can generate a video content of a preset time length based on the picture media item.

[0043] In some embodiments, the time length of such a media content may, for example, also be determined based on the selected media item (e.g., the media item 221). Specifically, when the applied media item is of a second type (e.g., a video media item), the electronic device 110 can generate a video content of a corresponding time length based on the time length of the video media item. For example, the media content can include only the selected video media item, or can include a combination of the video media item and other segments (e.g., a transition effect).

[0044] In some embodiments, as shown in FIG. 2B, the electronic device 110 can also provide a corresponding usage entry 222 in association with the media item 221. Upon receiving a selection of the usage entry 222, the electronic device 110 can apply the media item 221 to a current segment (e.g., the segment 241) and accordingly generate a media content 242 corresponding to the segment 241 based on the media item 221. FIG. 2A In some embodiments, the electronic device 110 can also add the media item 221 to the media component 230 for subsequent usage or management based on the selection of the usage entry 222.

[0045] As shown in FIG. 2B, the electronic device 110 can also provide an adding entry (e.g., a “+” button) in the track component 240. Upon receiving a selection of the adding entry, the electronic device 110 can accordingly create a new empty segment (or, an empty shot) in the track component 240 for editing.

[0046] FIG. 2A

[0047] ​​In some embodiments, the electronic device 110 can also adjust the position of the segment 221 in the track component based on an adjustment request. For example, the electronic device 110 can adjust the segment 241 to other positions based on a drag operation on the segment 241. Accordingly, the electronic device 110 can associate the generated media content 242 to a time period corresponding to the adjusted position.

[0048] Based on the above described manners, embodiments of the present disclosure can support the generation of corresponding media content in the editing interface, and can add the media content as material available for segment editing. Accordingly, embodiments of the present disclosure can also implement the editing of segments based on the added material to generate corresponding video content. In this way, embodiments of the present disclosure can provide the efficiency of media editing.

[0049] FIG. 2B An example interface 200B is shown according to some other embodiments of the present disclosure. As shown, the generation component 210 can also support the generation of video content, for example. Specifically, the electronic device 110 can determine to use a picture-based generation mode or a text-based generation mode based on the selection of the entry 211 or the entry 212, for example. FIG. 2B

[0050] In some embodiments, as shown, in the text-based generation mode 215, the electronic device 110 can provide different generation modes in the generation component 210, such as a picture-based generation mode 214 and a text-based generation mode 215, for example. FIG. 2B

[0051] As an example, in the case where the text-based generation mode 215 is selected, the electronic device 110 can acquire prompt items similar to FIG. 2A and provide video content generated based on the prompt items.

[0052] On the contrary, in the case where the picture-based generation mode 214 is selected, the electronic device 110 can provide an image selection control 216 in the generation component 210, and can acquire a reference image for video content generation based on the image selection control 216.

[0053] In some embodiments, the electronic device 110 can support the user to acquire the reference image by uploading an existing image, for example. In some other embodiments, in the case where “use tail frame” is turned on, the reference image can be determined automatically as determined by the media content 242 corresponding to the previous segment 241 of the current segment 243, for example. For example, the reference image can be determined as the last frame image of the media content 242.

[0054] In yet some other embodiments, the electronic device 110 can also support the user to generate a new media item based on the selection of existing material. As shown, the electronic device 110 can provide a media item selection control 217 in the generation component 210, and can acquire a selected media item based on the selection of the media item selection control 217.​​FIG. 2C As shown, the electronic device 110 can provide a generation entry 232 for generating a video in association with the material (e.g., the media item 221).

[0055] In some embodiments, upon receiving a selection of the generation entry 232, the electronic device 110 can determine the media item 221 as a reference image, and can display the reference image in the image selection control 216 of the generation component.

[0056] Further, as FIG. 2C shown, the electronic device 110 can also provide an input control 217 for inputting a prompt item. Further, the electronic device 110 can generate a corresponding video content 224 based on the reference image (e.g., the media item 221, or a user-uploaded image, or the last frame image of a previous segment) and the received prompt item.

[0057] Further, the electronic device 110 can support the user to add the video content 224 as a new material, or directly apply to a current segment, e.g., the segment 243, to generate a corresponding media content 244, based on the above-described processes.

[0058] Additionally, the electronic device 110 can also provide a re-generation entry in association with the material (e.g., the media item 221) in the material component 230 for triggering a re-generation. Upon receiving a selection of the re-entry, the electronic device 110 can generate a new set of media items based on the same input information (e.g., the same prompt item).

[0059] Additionally, the electronic device 110 can also provide a re-edit entry 233 in association with the material (e.g., the media item 221) in the material component 230 for triggering a re-edit. Upon receiving a selection of the re-edit entry 233, the electronic device 110 can populate the generation component 210 with the input information, e.g., display the prompt item corresponding to the set of media items 221 in the input control 213, to support further editing of the prompt item by the user.

[0060] Additionally, the electronic device 110 can also provide an entry 234 in association with the material (e.g., the media item 221) in the material component for deleting the material, for example.

[0061] As FIG. 2CAs shown, the electronic device 110 can also provide a control 245 in the interface 200C. Upon receiving a selection of the control 245, the electronic device 110 can present, in the track component 240, description information corresponding to the added segments (e.g., segment 241, segment 243), etc. In some embodiments, such description information may, for example, include a time length of the shot, scene information of the shot, etc.

[0062] In some embodiments, the electronic device 110 can also provide a control 246. In some embodiments, the electronic device 110 can receive an audio generation request based on a selection of the control 246, and can accordingly present an audio generation component (not shown in the figure).

[0063] Specifically, the electronic device 110 can obtain corresponding configuration information based on the audio generation component, and generate audio content corresponding to the segment 241 and / or the segment 243 based on the configuration information.

[0064] In some embodiments, such audio content may, for example, include narration content corresponding to the segments. In some embodiments, the obtained configuration information may, for example, include timbre information of the narration content, script of the narration content, prompt items for generating the narration content, etc.

[0065] In some embodiments, the electronic device 110 can also provide a control 247. The electronic device 110 can receive a script editing request based on a selection of the control 247.

[0066] Exemplarily, the electronic device 110 can present a script editing window 200D as shown in the figure based on the received script editing request. In the script editing window, the electronic device 110 can support the user to edit and manage the segments by editing the script. FIG. 2D

[0067] In some embodiments, the electronic device 110 can display, in the script editing window 2200D, a set of input controls corresponding to the at least one segment. In some embodiments, the set of input controls includes at least one of: a first input control 250 for inputting scene description content; a second input control 251 for inputting shot description content; a third input control 252 for inputting dialogue content.

[0068] Additionally, the electronic device 110 can also provide, in association with each scene, media content corresponding to the segments (or shots) in the corresponding scene, for example, the media content 242.

[0069] In this way, embodiments of the present disclosure can support the user to further edit the editing result in the editing interface by script editing, thereby improving the efficiency of editing.​

[0070] Based on the above-described process, embodiments of the present disclosure can provide a convenient media editing page, implement media content generation and media content editing integration, and improve the efficiency of media editing.

[0071] Example Process

[0072] FIG. 3 A flowchart of a media editing process 300 according to some embodiments of the present disclosure is shown. The process 300 can be implemented at the electronic device 110. Reference is made below to the electronic device 110 and the media editing application 120 in describing the process 300. FIG. 1 The process 300 is described.

[0073] At block 310, the electronic device 110 provides, in the editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface.

[0074] At block 320, the electronic device 110 adds, in a material component of the editing interface, at least one media item selected from the set of candidate media items as candidate material based on a first operation on the at least one media item.

[0075] At block 330, the electronic device 110 receives a request to apply a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing, generates a first media content corresponding to the first segment.

[0076] At block 340, the electronic device 110 generates a media editing result based at least on the first media content.

[0077] In some embodiments, providing, in the editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface includes determining a prompt item based on the input information received by the generation component, and providing, in the editing interface, a set of candidate media items generated based on the prompt item.

[0078] In some embodiments, the generation component further includes an image selection control, and the set of candidate media items is further generated based on a reference image determined via the image selection control.

[0079] In some embodiments, the reference image includes at least one of: a first image determined based on a preset operation on a second material in the material component, a second image determined based on an image upload operation, and a third image determined based on a second media content corresponding to a second segment preceding the first segment in the track component.

[0080] In some embodiments, the process 300 further includes: based on the second operation on the at least one media item in the set of candidate media items, applying the at least one media item to a current segment in the track component to generate third media content corresponding to the current segment; and adding the at least one media item to the material component as candidate material.

[0081] In some embodiments, the set of media items is a first set of media items, and the process 300 further includes: receiving a regeneration request associated with the input information; and providing, in the editing interface, a second set of media items generated based on the input information.

[0082] In some embodiments, receiving the regeneration request associated with the input information includes: receiving a selection of a first regeneration entry, the first regeneration entry being associated with the first set of media items; or receiving a selection of a second regeneration entry, the second regeneration entry being associated with the at least one media item added in the material component.

[0083] In some embodiments, the process 300 further includes: receiving a re-editing request associated with the input information; and populating the generation component based on the input information.

[0084] In some embodiments, receiving the re-editing request associated with the input information includes: receiving a selection of a first re-editing entry, the first re-editing entry being associated with the set of media items; or receiving a selection of a second re-editing entry, the second re-editing entry being associated with the at least one media item added in the material component.

[0085] In some embodiments, the process 300 further includes: receiving a selection of an addition entry in the track component; and adding an empty segment for editing in the track component.

[0086] In some embodiments, in response to the first material being of a first type, the first media content is generated based on a preset time length; and / or in response to the first material being of a second type, the first media content is generated based on a time length of the first material.

[0087] In some embodiments, the process 300 further includes: based on an audio generation request for the first media content, presenting an audio generation component; and generating target audio content corresponding to the first media content based on configuration information obtained via the audio generation component.

[0088] In some embodiments, the process 300 further includes: based on the received script editing request, presenting a script editing window corresponding to the media editing result; and displaying, in the script editing window, a set of input controls corresponding to the at least one segment.

[0089] In some embodiments, a set of input controls includes at least one of the following: a first input control for inputting scene description content; a second input control for inputting shot description content; and a third input control for inputting dialogue content.

[0090] In some embodiments, process 300 further includes presenting first media content corresponding to the first segment in the script editing window.

[0091] In some embodiments, process 300 further includes, based on an adjustment request to adjust a position of the first segment in the track component, associating the first media content with a time period corresponding to the adjusted position.

[0092] Example Devices and Equipment

[0093] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. FIG. 4 1 shows a schematic structural block diagram of an apparatus 400 for media editing according to certain embodiments of the present disclosure. The apparatus 400 may be implemented as or included in the electronic device 110 discussed above. Each module / component in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0094] like FIG. 4 As shown, the device 400 includes a first providing module 410, which is configured to provide a group of candidate media items generated based on input information in the editing interface based on input information received in the generating component of the editing interface; a first adding module 420, which is configured to add at least one selected media item as a candidate material in the material component of the editing interface based on a first operation on at least one media item in the group of candidate media items; a first generating module 430, which is configured to receive a request to apply the first material in the material component to the first segment of the track component, generate first media content corresponding to the first segment, and the track component displays at least one segment for editing; and a second generating module 440, which is configured to generate a media editing result based on at least the first media content.

[0095] In some embodiments, the first providing module 410 is specifically configured to determine a prompt item based on input information received by the generating component; and provide a group of candidate media items generated based on the prompt item in the editing interface.

[0096] In some embodiments, the generation component further includes an image selection control, and the set of candidate media items is further generated based on the reference image determined via the image selection control.

[0097] In some embodiments, the reference image comprises at least one of: a first image determined based on a preset operation on a second material in the material component; a second image determined based on an image uploading operation; and a third image determined based on second media content corresponding to a previous second segment in the track component.

[0098] In some embodiments, the apparatus 400 further comprises a third generation module configured to apply at least one media in the track component to a current segment in the track component to generate third media content corresponding to the current segment based on a second operation on at least one media in the group of candidate media items; and a second adding module configured to add the at least one media to the material component as candidate material.

[0099] In some embodiments, the group of media items is a first group of media items, the apparatus 400 further comprises a first receiving module configured to receive a regeneration request associated with input information; and a second providing module configured to provide a second group of media items generated based on the input information in the editing interface.

[0100] In some embodiments, the first receiving module is specifically configured to receive a selection of a first regeneration portal associated with the first group of media items; or receive a selection of a second regeneration portal associated with the at least one media added in the material component.

[0101] In some embodiments, the apparatus 400 further comprises a second receiving module configured to receive a re-editing request associated with input information; and a filling module configured to fill the generation component based on the input information.

[0102] In some embodiments, the second receiving module is specifically configured to receive a selection of a first re-editing portal associated with the group of media items; or receive a selection of a second re-editing portal associated with the at least one media added in the material component.

[0103] In some embodiments, the apparatus 400 further comprises a third receiving module configured to receive a selection of an adding portal in the track component; and a third adding module configured to add an empty segment for editing in the track component.

[0104] In some embodiments, the first media content is generated based on a preset time length in response to the first material being of a first type; and / or the first media content is generated based on a time length of the first material in response to the first material being of a second type.

[0105] In some embodiments, the apparatus 400 further includes a first presenting module, configured to present the audio generation component based on the audio generation request for the first media content; and a fourth generating module, configured to generate the target audio content corresponding to the first media content based on the configuration information acquired via the audio generation component.

[0106] In some embodiments, the apparatus 400 further includes a second presenting module, configured to present a script editing window corresponding to the media editing result based on the received script editing request; and a displaying module, configured to display a set of input controls corresponding to the at least one segment in the script editing window.

[0107] In some embodiments, the set of input controls includes at least one of: a first input control for inputting scene description content; a second input control for inputting shot description content; and a third input control for inputting dialogue content.

[0108] In some embodiments, the apparatus 400 further includes a third presenting module, configured to present the first media content corresponding to the first segment in the script editing window.

[0109] In some embodiments, the apparatus 400 further includes an associating module, configured to associate the first media content to a time period corresponding to the adjusted position of the first segment based on an adjusting request of adjusting the position of the first segment in the track component.

[0110] The units included in the apparatus 400 can be implemented by various means, including software, hardware, firmware, or any combination of these. In some embodiments, one or more units can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units of the apparatus 400 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (ASICs), Application-specific Standard Products (ASSPs), System-on-a-Chip (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0111] FIG. 5 A block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented is shown. It should be understood that FIG. 5 The electronic device 500 shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments described herein. FIG. 5 The electronic device 500 shown can be used to implement FIG. 1 The electronic device 110 shown.

[0112] AsFIG. 5 As shown, the electronic device 500 is in the form of a general electronic device. Components of the electronic device 500 can include, but are not limited to, one or more processors or processing units 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in the memory 520. In a multi-processing system, multiple processing units execute computer-executable instructions in parallel to improve the processing power of the electronic device 500.

[0113] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically-erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable media and can include a machine-readable medium, such as a flash drive, a magnetic disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and that can be accessed by the electronic device 500.

[0114] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5 FIG. 5, a disk drive for reading from or writing to a non-removable, non-volatile magnetic media (e.g., a "hard drive") and an optical disk drive for reading from or writing to a removable, non-volatile optical media (e.g., a "CD-ROM" or "DVD") can be provided. In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0115] The communication unit 540 enables communication with other electronic devices over communication media. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. As such, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in the networking environment.

[0116] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices, as desired via the communication unit 540. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0117] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0118] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0119] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0120] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0121] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer program components embodied in medium and / or transmission signals.

[0122] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations of the disclosure have been described with regard to one or more implementations, it will be recognized that a variety of modifications and changes can be made to these implementations without departing from the broader spirit and scope of the implementations as set forth in the preceding disclosure. For example, certain aspects of the implementations can be performed using hardware, software, and / or firmware, or any combination thereof. The above-described implementations should therefore be regarded as merely illustrative, and not as narrowing the scope of the disclosure, which is defined by the appended claims and their equivalents.

Claims

1. A media editing method, comprising: providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface; adding, in a material component of the editing interface, at least one media item of the set of candidate media items as a candidate material based on a first operation on the at least one media item; receiving a request of applying a first material in the material component to a first segment of a track component, the track component displaying at least one segment for editing, generating a first media content corresponding to the first segment; and generating a media editing result based at least on the first media content. 2.The method of claim 1, wherein providing, in an editing interface, a set of candidate media items generated based on input information received in a generation component of the editing interface comprises: determining a prompt item based on the input information received by the generation component; and providing, in the editing interface, the set of candidate media items generated based on the prompt item. 3.The method of claim 2, wherein the generation component further comprises an image selection control, and the set of candidate media items is further generated based on a reference image determined via the image selection control. 4.The method of claim 3, wherein the reference image comprises at least one of: a first image determined based on a preset operation on a second material in the material component; a second image determined based on an image uploading operation; a third image determined based on a second media content corresponding to a second segment preceding the first segment in the track component. 5.The method of claim 1, further comprising: applying the at least one media item to a current segment in the track component to generate a third media content corresponding to the current segment based on a second operation on the at least one media item of the set of candidate media items; and adding the at least one media item to the material component as a candidate material. 6.The method of claim 1, wherein the set of media items is a first set of media items, the method further comprising: receiving a re-generation request associated with the input information; and providing, in the editing interface, a second set of media items generated based on the input information. 7.The method of claim 6, wherein receiving a re-generation request associated with the input information comprises: receiving a selection of a first re-generation entry, the first re-generation entry associated with the first set of media items; or receiving a selection of a second re-generation entry, the second re-generation entry associated with the at least one media item added in the material component. 8.The method of claim 1, further comprising: receiving a re-editing request associated with the input information; and populating the generation component based on the input information. 9.The method of claim 8, wherein receiving a re-editing request associated with the input information comprises: ​ ​ ​ ​ ​ receiving a selection of a first re-edit entry, the first re-edit entry being associated with the set of media items; or receiving a selection of a second re-edit entry, the second re-edit entry being associated with the added at least one media item in the material assembly.

10. The method of claim 1, further comprising: receiving a selection of an add entry in the track assembly; and adding an empty segment for editing in the track assembly.

11. The method of claim 1, wherein: in response to the first material being of a first type, generating the first media content based on a preset time length; and / or in response to the first material being of a second type, generating the first media content based on a time length of the first material.

12. The method of claim 1, further comprising: based on an audio generation request for the first media content, presenting an audio generation assembly; and generating target audio content corresponding to the first media content based on configuration information obtained via the audio generation assembly.

13. The method of claim 1, further comprising: based on a received script editing request, presenting a script editing window corresponding to the media editing result; and displaying a set of input controls corresponding to the at least one segment in the script editing window.

14. The method of claim 13, wherein the set of input controls comprises at least one of: a first input control for inputting scene description content; a second input control for inputting shot description content; a third input control for inputting dialogue content.

15. The method of claim 13, further comprising: presenting the first media content corresponding to the first segment in the script editing window.

16. The method of claim 1, further comprising: based on an adjustment request to adjust a position of the first segment in the track assembly, associating the first media content to a time period corresponding to the adjusted position.

17. An apparatus for media editing, comprising: a first providing module configured to provide, in an editing interface, a set of candidate media items generated based on input information received in a generation assembly of the editing interface; a first adding module configured to add, in a material assembly of the editing interface, at least one media item selected from the set of candidate media items as a candidate material based on a first operation on the at least one media item; a first generating module configured to receive a request to apply a first material in the material assembly to a first segment of a track assembly, the track assembly displaying at least one segment for editing, and generate a first media content corresponding to the first segment; and a second generating module configured to generate a media editing result based on at least the first media content.

18. An electronic device, comprising: at least one processing unit; and ​ ​ at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1 to 16.

19. A computer readable storage medium having stored thereon a computer program, the computer program, when executed by a processor, implementing the method according to any one of claims 1 to 16.

Images