Media editing method and apparatus, device, and storage medium

Abstract

Embodiments of the present disclosure provide a media editing method and apparatus, a device, and a storage medium. The method comprises: displaying a first storyboard component in a storyboard editing area of an editing interface; in response to receiving a preset operation in the first storyboard component, displaying a media generation area in the editing interface; on the basis of parameter information acquired in the media generation area, generating a first storyboard segment corresponding to the first storyboard component; and displaying the first storyboard segment in a content preview area of the editing interface. In this way, in the embodiments of the present disclosure, a corresponding segment of media content can be efficiently edited by means of a storyboard component, thereby improving the media editing efficiency.

Description

Media editing method, apparatus, device, and storage medium

[0001] The present application claims priority to the Chinese Patent Application No. 202410869687.6, filed on June 28, 2024, entitled “Media editing method, apparatus, device, and storage medium”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a media editing method, apparatus, device, and computer readable storage medium. BACKGROUND

[0003] With the rapid development of intelligence, various forms of electronic devices can greatly enrich people's daily life. For example, a user can perform media editing based on some electronic devices to generate a media editing result. The form of the media editing result includes, for example, but is not limited to, a picture, an audio, a video, a text, and the like. SUMMARY

[0004] In a first aspect of the present disclosure, a media editing method is provided. The method includes: displaying a first split screen component in a split screen editing area of an editing interface; in response to receiving a preset operation in the first split screen component, displaying a media generation area in the editing interface; generating a first split screen clip corresponding to the first split screen component based on parameter information obtained in the media generation area; and displaying the first split screen clip in a content preview area of the editing interface.

[0005] In a second aspect of the present disclosure, an apparatus for media editing is provided. The apparatus includes: a split screen display module configured to display a first split screen component in a split screen editing area of an editing interface; a parameter editing module configured to display a media generation area in the editing interface in response to receiving a preset operation in the first split screen component; a split screen generation module configured to generate a first split screen clip corresponding to the first split screen component based on parameter information obtained in the media generation area; and a split screen preview module configured to display the first split screen clip in a content preview area of the editing interface.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product includes computer executable instructions, wherein the computer executable instructions implement the method of the first aspect when executed by a processor.

[0009] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the present disclosure or the present disclosure. Other features of the present disclosure will be apparent from the following description, the drawings, and the claims. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, wherein:

[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] FIGS. 2A-2G show schematic diagrams of interfaces, according to some embodiments of the present disclosure;

[0013] FIG. 3 shows a flowchart of a process of media editing, according to some embodiments of the present disclosure;

[0014] FIG. 4 shows a schematic structural block diagram of an apparatus for media editing, according to certain embodiments of the present disclosure;

[0015] FIG. 5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0016] Embodiments of the present disclosure will be described in more detail with reference to the drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure will be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and should not be construed as limiting the scope of protection of the present disclosure.

[0017] It should be noted that the headings provided in any section / subsection herein are not limitations. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiments described in the same section / subsection and / or different section / subsection in any manner.

[0018] In the description of embodiments of the disclosure, the term "includes" and its conjugates are open-ended, meaning "including but not limited to". The term "based on" is intended to mean "based, at least in part, on" The term "one embodiment" or "an embodiment" means "at least one embodiment". The term "some embodiments" means "at least some embodiments". Other explicit or implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or the same objects. Other explicit and implicit definitions can also be included below.

[0019] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, when implementing embodiments of the disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained according to relevant laws and regulations through appropriate means. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the disclosure is not limited in this respect.

[0020] In the specification and embodiments of the present disclosure, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0021] As discussed above, the creation and editing of media content such as video content has become an important daily task. How to improve the editing efficiency of media content and reduce the time cost / learning cost of media editing is the focus of attention.

[0022] Embodiments of the present disclosure propose a media editing scheme. According to the scheme, a first storyboard component can be displayed in a storyboard editing area of an editing interface. Further, a media generation area can be displayed in the editing interface in response to receiving a preset operation in the first storyboard component. Accordingly, a first storyboard clip corresponding to the first storyboard component can be generated based on parameter information acquired in the media generation area. Additionally, the first storyboard clip can be displayed in a content preview area of the editing interface.

[0023] In this way, embodiments of the present disclosure can efficiently edit corresponding clips of media content through storyboard components, thereby improving the efficiency of media editing.

[0024] Example Environment

[0025] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.

[0026] In this example environment 100, an application 120 is installed in the electronic device 110. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices. The application 120 can be a media editing application, or the like, or any other suitable application. For example, the application 120 can be a browser and provide media editing services by accessing a website.

[0027] In the environment 100 of FIG. 1, the application 120 can provide a presentation interface 150 for the user 140 to perform media editing operations based on the interface 150 if the application 120 is in an active state.

[0028] In some embodiments, the electronic device 110 communicates with a server 130 to implement the provision of services of the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a notebook computer, a laptop computer, a netbook computer, a smartbook, a tablet computer, a media computer, a multi- media tablet, a personal digital assistant (PDA), a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combinations of the aforementioned and the like, including accessories and peripherals for these devices, or any combinations thereof. In some embodiments, the electronic device 110 can also be capable of supporting any type of interface to a user (such as "wearable" circuitry, etc.).

[0029] The server 130 can be a standalone physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content distribution network, and basic cloud computing services such as big data and artificial intelligence platform. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports content presentation.

[0030] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a universal serial bus connection, a wireless fidelity connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can achieve signaling interaction through the communication connection therebetween.

[0031] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0032] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0033] Example interaction

[0034] An example interaction process according to embodiments of the present disclosure will be described below with reference to FIGS. 2A-2G. FIGS. 2A-2G show example interfaces 200A-200G, which may, for example, be provided by the electronic device 110 shown in FIG. 1, according to some embodiments of the present disclosure.

[0035] As shown in FIG. 2A, an example editing interface 200A is shown. As shown in FIG. 2A, the interface 200A can be used to create new media content. Accordingly, the interface 200A includes an entry 202 for importing storyboard materials and an entry 204 for creating a new storyboard.

[0036] In some embodiments, as shown in FIG. 2B, upon receiving a selection for the entry 204, the electronic device 110 can display a first storyboard component 212 in a storyboard editing area 210 of an editing interface 200B. In some scenarios, the first storyboard component 212 can also be referred to as a storyboard card.

[0037] In some embodiments, the first storyboard component 212 can include a plurality of input controls. For example, the first storyboard component 212 can include an input control 214 for importing material. For example, a user can import picture material or video material for a corresponding storyboard segment via the input control 214.

[0038] As another example, the first storyboard component 214 can further include an input control 216 for inputting storyboard description information. For example, a user can input textual content for describing a storyboard segment via the input control 216.

[0039] Further, the first storyboard component 214 can further include one or more generation entrances, e.g., a generation entrance 218 and a generation entrance 220. In some embodiments, the generation entrances provided in the first storyboard component 212 can be determined based on the inputted reference information. Such reference information can include reference material and / or storyboard description information.

[0040] For example, when only storyboard description information is inputted, the first storyboard component 212 can provide a generation entrance 218 for generating a picture based on the text and a generation entrance 220 for generating a video based on the text. As another example, when the reference information further includes picture material, the first storyboard component 212 may, for example, only provide a generation entrance for generating a video based on the picture.

[0041] As an example, the electronic device 110 can receive a user selection of the generation entrance 218. Further, the electronic device 110 can accordingly present a media generation region 230 corresponding to the first storyboard component 212.

[0042] It should be appreciated that the media generation region 230 can be displayed based on the triggering of the generation entrance 218. Alternatively, the electronic device 110 can continuously display the media generation region 230 and can associate the media generation region 230 to the first storyboard component 214 based on the selection of the generation entrance 218.

[0043] As shown in FIG. 2B, the media generation region 230 can include a plurality of controls for inputting generation parameters, e.g., a control 232 and a control 234, etc. In some embodiments, the parameters of at least one of such controls can be determined based on the input information in the first storyboard component 212.

[0044] For example, the control 232 can be used for inputting a prompt item for generating video content. Accordingly, the control 232 can be filled with the storyboard description information received via the input control 216 accordingly.

[0045] As another example, the control 234 can be used to input a reference image for generating the video content. Accordingly, the control 234 can correspondingly use the picture material received via the input control 214 as the reference image.

[0046] It is to be understood that the electronic device 110 can further receive an editing operation of the user on the control 232 and / or the control 234 to modify the generation parameters corresponding to the controls. For example, the user can modify the initially filled-in shot description information based on the control 232 to input the final prompt item.

[0047] Further, the electronic device 110 can trigger generation of the corresponding media material based on the parameters information received in the media generation area 230 (i.e., one or more generation parameters) based on the selection of the generation button 236 by the user.

[0048] As shown in FIG. 2C, the electronic device 110 can obtain one or more media materials generated based on the parameters information, and can determine one of the media materials as a first shot segment 252 corresponding to the first shot component 212. Accordingly, the electronic device 110 can display the first shot segment 252 in the content preview area 250 of the editing interface 200C.

[0049] Additionally, the electronic device 110 can update the first shot component 212 to display a video frame 224 in the first shot segment 252, for example, the first video frame.

[0050] Additionally, the electronic device 110 can further provide one or more editing entrances, for example, the editing entrance 226 and the editing entrance 228, in the first shot component 212.

[0051] Exemplarily, the editing entrance 226 can be used to re-edit the parameters for generating the first shot segment 252. Specifically, the electronic device 110 can receive a selection of the editing entrance 226, and can display the parameter information for generating the first shot segment 252 in the media generation area 230.

[0052] Further, the electronic device 110 can receive an editing operation of the user on the parameter information (also referred to as first parameters) to obtain updated parameter information (also referred to as second parameter information). Accordingly, the electronic device 110 can further trigger re-uploading of the first shot segment 252 based on the second parameter information.

[0053] Specifically, the electronic device 110 can trigger generation of a new set of media materials based on the second parameter information, and replace the existing first shot segment 252 with one of the media materials.

[0054] In some embodiments, the first split-screen segment 252 can correspond to a picture material. For example, the picture material is taken as a video frame within the time period of the first split-screen segment 252. It should be understood that in this case, the first split-screen segment 252 may, for example, be generated based on a picture generation function in the media generation region 230.

[0055] Accordingly, the electronic device 110 can provide a first video generation entry 228 in the first split-screen component 212. Upon receiving a selection of the first video generation entry 228, the electronic device 110 can accordingly display or update the media generation region 230.

[0056] Specifically, the media generation region 230 can be used to obtain a set of parameters (also referred to as third parameter information) for generating video content based on the picture material. Accordingly, the set of parameters may, for example, include the picture material corresponding to the first split-screen segment 252 as a reference image (e.g., a first frame) for generating the video.

[0057] In some embodiments, the first split-screen segment 252 can also correspond to a video material. Accordingly, the editing entries provided in the first split-screen component 212 may, for example, only include editing entries for re-editing.

[0058] In some embodiments, the electronic device 110 can also display one or more editing entries 254 for editing the first split-screen segment 252 in the content preview region 250. As an example, such editing entries 254 may, for example, be used to perform various appropriate types of editing operations on the first split-screen segment 252, such as a partial redrawing operation, an expansion operation, an elimination operation, a picture super-clear operation, etc.

[0059] Additionally, the electronic device 110 can also add the generated one or more split-screen materials to the material library, and can display the one or more split-screen materials in a material management region 270 of the editing interface 200C.

[0060] As an example, the split-screen materials generated based on the parameter information can include the first split-screen segment 252, split-screen materials 272, 274 and 276, etc. In some embodiments, the above split-screen materials can also be associated to the first split-screen component 212.

[0061] In some embodiments, the material management region 270 can include a plurality of viewing entries, such as a first viewing entry (e.g., a “project material” tab) for viewing all materials and a second viewing entry (e.g., a “split-screen material” tab) for viewing a specific split-screen material.

[0062] Accordingly, the electronic device 110 can receive a selection of the first viewing portal and display all of the materials in the project, including uploaded materials and / or generated materials, in the material management region 270.

[0063] As another example, the electronic device 110 can also receive a selection of any of the shot assemblies and display a set of materials corresponding to the shot assembly in the “Shot Materials” tab. For example, the electronic device 110 can receive a selection of the first shot assembly 212 and display a set of materials associated with the first shot assembly 212 in the material management region 270. Such a set of materials includes shot materials generated based on the parameter information, such as the first shot clip 252, the shot materials 272, 274, and 276, etc.

[0064] In some embodiments, the electronic device 110 can receive a selection of an image material in the material management region and present a corresponding video generation portal to trigger generation of corresponding video content based on the image material accordingly.

[0065] In some embodiments, the electronic device 110 can also receive a selection of a shot material generated based on the parameter information. For example, the electronic device 110 can receive a selection of the shot material 272 and can present a re-edit portal for re-editing the shot material 272 accordingly. Further, upon receiving a selection of the re-edit portal, the electronic device 110 can display the parameter information used to generate the shot material 272 in the media generation region 230 to support further editing of the parameter information.

[0066] In some embodiments, the electronic device 110 can also support creation of a new shot clip based on materials in the material management region 270. As an example, the electronic device 110 can receive a selection of the shot material 272 and can create a second shot clip corresponding to the shot material 272 accordingly. Further, as shown in FIG. 2D, the electronic device 110 can also display a second shot assembly 282 corresponding to the created second shot clip.

[0067] For example, a user can create a new shot assembly by dragging the shot material 272 from the material management region 270 to the shot edit region 210.

[0068] In some embodiments, the split-edit region 210 can present a plurality of split components corresponding to a plurality of split segments in the media content. In some embodiments, the electronic device 110 can further support further editing operations on two adjacent split components. Specifically, the electronic device 110 can receive, for example, a selection of the first split component 212 and the second split component 282. It is to be understood that the first split component 212 and the second split component 282 are merely illustrated as examples, and are not intended to require that they are created based on the corresponding creation process described above.

[0069] In some embodiments, the electronic device 110 can present a video generation entry based on the selection of the first split component 212 and the second split component 282. Accordingly, upon receiving a selection of the video generation entry, the electronic device 110 can trigger generation of a video content based on the first split segment and a second split segment corresponding to the second split component 282.

[0070] Further, the electronic device 110 can replace the existing first split segment and the second split segment with the video content as a new split segment. In addition, the electronic device 110 can also create a new split component to replace the existing first split component 212 and the second split component 282.

[0071] In some embodiments, the first split segment can correspond to a first image material, and the second split segment can correspond to a second image material, for example. In this case, a first frame of the generated video content can be determined based on the first image material, and a last frame of the video content can be determined based on the second image material, for example.

[0072] In some embodiments, the electronic device 110 can further support modification of the length of a split component. Specifically, the electronic device 110 can receive, for example, an editing operation on the first split component 212 to modify the size of the first split component 212 to delay the time length of the first split segment 252.

[0073] For example, the electronic device 110 can receive a drag operation of a user on a right boundary of the first split component 212 to extend the time length of the first split segment 252, for example, from 3 seconds to 6 seconds.

[0074] Further, the electronic device 110 can generate a second set of video frames corresponding to the blank segment in the first split segment based on a first set of video frames in the first split segment 252. For example, the electronic device 110 can generate video frames for the last 3 seconds based on the video frames for the first 3 seconds to complete the extension of the first split segment 252.

[0075] In some embodiments, the electronic device 110 can also receive a user’s movement operation on the split shot component (e.g., the first split shot component 212 or the second split shot component 282) to change the component order of the split shot component in the split shot editing area. For example, the first split shot component 212 can be moved to the back of the second split shot component 282.

[0076] Accordingly, the electronic device 110 can adjust the order of the corresponding split shot clip in the media content based on the component order. For example, the first split shot clip 252 can be adjusted to the back of the second split shot clip.

[0077] In some embodiments, due to the limited display size of the split shot editing area 210, the split shot editing area 210 may, for example, only present a first number of split shot components among the created plurality of split shot components. Taking FIG. 2D as an example, the split shot editing area 210 may, for example, only display 2 split shot components.

[0078] Further, the electronic device 110 can receive a user’s viewing request (e.g., a trigger on a specific button) and may, accordingly, present the interface 200E as shown in FIG. 2E.

[0079] As shown in FIG. 2E, the electronic device 110 can present the split shot viewing area 280. Compared with the interface 200D, the electronic device 110 can stop displaying the content preview area 250 so that the split shot viewing area 280 has a larger display size for showing a larger number of split shot components. For example, the electronic device 110 can display the first split shot component 212, the second split shot component 282, the split shot component 284, and the split shot component 286.

[0080] In some embodiments, the electronic device 110 can support editing operations similar to the split shot editing area 210 in the split shot viewing area 280. For example, the electronic device 110 can support creating a new split shot component, can edit an existing split shot component, and the like.

[0081] In some embodiments, the electronic device 110 can also add target audio content based on a user’s editing operation to constitute a soundtrack of the media content. For example, the electronic device 110 can add the target audio content as background music for a specific time range.

[0082] In some embodiments, as shown in FIG. 2F, the electronic device 110 can also display an audio track 290 corresponding to the added target audio content in the split shot editing area 210. In some embodiments, the display position of the audio track 290 in the split shot editing area 210 can be determined based on the time range of the target audio content in the media content.

[0083] In some embodiments, as shown in FIG. 2G, the electronic device 110 can further receive a track viewing request of the user to present multiple tracks of the media content in the editing interface 200G. For example, the user can trigger the track viewing request by clicking a specific control or performing other appropriate operations.

[0084] As shown in FIG. 2G, the electronic device 110 can display multiple tracks. For example, the electronic device 110 can display a split track 292 to demonstrate one or more split segments in the media content. Unlike the split component in FIG. 2F, the split track 292 can demonstrate corresponding split segments according to the time length of each split segment.

[0085] In addition, the electronic device 110 can further present one or more audio tracks corresponding to one or more audio contents added in the media content, for example, an audio track 294 and an audio track 296. In some embodiments, the multiple tracks (e.g., the split track 292, the audio track 294, the audio track 296) can be aligned in time.

[0086] In this way, embodiments of the present disclosure can edit different split segments of the media content through the split component, thereby improving the efficiency of media editing.

[0087] Example process

[0088] FIG. 3 illustrates a flowchart of a media editing process 300 according to some embodiments of the present disclosure. The process 300 can be implemented at the electronic device 110. The process 300 is described below with reference to FIG. 1.

[0089] At block 310, the electronic device 110 displays a first split component in a split editing area of an editing interface.

[0090] At block 320, the electronic device 110 displays a media generation area in the editing interface in response to receiving a preset operation in the first split component.

[0091] At block 330, the electronic device 110 generates a first split segment corresponding to the first split component based on parameter information obtained in the media generation area.

[0092] At block 340, the electronic device 110 displays the first split segment in a content preview area of the editing interface.

[0093] In some embodiments, displaying the first split component in the split editing area of the editing interface includes: receiving a selection of a creation portal in the split editing area; and displaying the first split component in the editing interface in response to the selection.

[0094] In some embodiments, in response to receiving the preset operation in the first split-screen component, displaying the media generation region in the editing interface includes: acquiring, via the first split-screen component, reference information for generating the split-screen segment; and in response to receiving a generation request associated with the reference information, displaying the media generation region in the editing interface, wherein a parameter of at least one control in the media generation region is determined based on the reference information.

[0095] In some embodiments, acquiring, via the first split-screen component, the reference information for generating the split-screen segment includes: acquiring, via a first input control of the first split-screen component, description text of the split-screen; and / or acquiring, via a second input control of the first split-screen component, reference materials of the split-screen.

[0096] In some embodiments, in response to receiving the generation request associated with the reference information, displaying the media generation region in the editing interface includes: displaying at least one generation entry in the first split-screen component; and in response to selection of a target generation entry in the at least one generation entry, displaying the media generation region in the editing interface.

[0097] In some embodiments, the at least one generation entry is determined based on the reference information.

[0098] In some embodiments, the process 300 further includes: in response to generating the first split-screen segment, displaying a video frame in the first split-screen segment in the first split-screen component.

[0099] In some embodiments, the process 300 further includes: in response to generating the first split-screen segment, displaying a first set of editing entries in the first split-screen component, the first set of editing entries including a first re-editing entry; and in response to selection of the first re-editing entry, displaying parameter information for generating the first split-screen segment in the media generation region.

[0100] In some embodiments, the parameter information is first parameter information, and the method further includes: based on second parameter information acquired in the media generation region, regenerating the first split-screen segment corresponding to the first split-screen component.

[0101] In some embodiments, the first split-screen segment corresponds to a picture material, and the first set of editing entries further includes a first video generation entry, and the method further includes: in response to selection of the first video generation entry, displaying the media generation region; and based on third parameter information acquired in the media generation region, generating first video content corresponding to the first split-screen component to replace the first split-screen segment, the third parameter information including at least one reference image, the at least one reference image including the picture material.

[0102] In some embodiments, the process 300 further includes displaying, in the material management region of the editing interface, at least one storyboard material generated based on the parameter information, the at least one storyboard material comprising the first storyboard segment.

[0103] In some embodiments, the material management region includes a first viewing portal, and the method further includes, in response to selection of the first viewing portal, displaying, in the material management region, all materials associated with the media content, the all materials comprising the generated materials and / or the uploaded materials.

[0104] In some embodiments, the material management region includes a second viewing portal, and the method further includes, in response to selection of the first storyboard component, displaying, in the material management region, a set of materials associated with the first storyboard component, the set of materials comprising the at least one storyboard material generated based on the parameter information.

[0105] In some embodiments, the process 300 further includes, in response to selection of an image material in the material management region, presenting a second video generation portal, the second video generation portal for triggering generation of second video content based on the image material.

[0106] In some embodiments, the process 300 further includes, in response to selection of the at least one storyboard material in the material management region, presenting a second re-editing portal, and in response to selection of the second re-editing portal, displaying, in the media generation region, the parameter information for generating the first storyboard segment.

[0107] In some embodiments, the process 300 further includes, based on selection of a target material in the material management region, creating a second storyboard segment corresponding to the target material, and displaying, in the storyboard editing region, a second storyboard component corresponding to the second storyboard segment.

[0108] In some embodiments, the process 300 further includes displaying, in a content preview region of the editing interface, a second set of editing portals for editing the first storyboard segment.

[0109] In some embodiments, the storyboard editing region further includes a third storyboard component corresponding to a third storyboard segment, the third storyboard component adjacent to the first storyboard component, and the method further includes, in response to selection of the first storyboard component and the third storyboard component, presenting a third video generation portal, and in response to selection of the third video generation portal, generating third video content based on the first storyboard segment and the third storyboard segment to replace the first storyboard segment and the third storyboard segment.

[0110] In some embodiments, the first storyboard segment corresponds to a first image material, the third storyboard segment corresponds to a second image material, and a first frame and a last frame of the third video content are determined based on the first image material and the second image material, respectively.

[0111] In some embodiments, the process 300 further includes receiving an editing operation for the first split-screen component, the editing operation being used to modify a size of the first split-screen component to indicate an extension of a time length of the first split-screen segment, and generating a second set of video frames corresponding to a blank segment in the first split-screen segment based on a first set of video frames in the first split-screen segment.

[0112] In some embodiments, the process 300 further includes adjusting a component order of the first split-screen component in the split-screen editing area based on the moving operation for the first split-screen component, and adjusting an order of the first split-screen segment in the media content to be generated.

[0113] In some embodiments, the split-screen editing area displays a first number of split-screen components in the plurality of split-screen components, the plurality of split-screen components corresponding to a plurality of split-screen segments of the media content to be generated, and the method further includes, in response to receiving the viewing request, stopping displaying the content preview area in the editing interface, and displaying a split-screen viewing area in the editing interface, the split-screen viewing area displaying a second number of split-screen components in the plurality of split-screen components, the second number being greater than the first number.

[0114] In some embodiments, the process 300 further includes, in response to the request of adding the target audio content, presenting an audio track corresponding to the target audio content in the split-screen editing area.

[0115] In some embodiments, the process 300 further includes, in response to receiving the track viewing request, presenting a plurality of tracks in the editing interface, the plurality of tracks including a split-screen track for presenting the at least one split-screen segment and at least one audio track corresponding to the added at least one item of audio content.

[0116] Example apparatus and device

[0117] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above-described methods or processes. FIG. 4 shows a schematic structural block diagram of an apparatus 400 for media editing according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in the electronic device 110 as discussed above. The various modules / components in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0118] As shown in FIG. 4, the apparatus 400 includes a split-screen display module 410 configured to display a first split-screen component in a split-screen editing area of an editing interface; a parameter editing module 420 configured to, in response to receiving a preset operation in the first split-screen component, display a media generation area in the editing interface; a split-screen generation module 430 configured to generate a first split-screen clip corresponding to the first split-screen component based on parameter information obtained in the media generation area; and a split-screen preview module 440 configured to display the first split-screen clip in a content preview area of the editing interface.

[0119] In some embodiments, the split-screen display module 410 is further configured to: receive a selection of a creation portal in the split-screen editing area; and in response to the selection, display the first split-screen component in the editing interface.

[0120] In some embodiments, the split-screen display module 410 is further configured to: obtain, via the first split-screen component, reference information for generating a split-screen clip; and in response to receiving a generation request associated with the reference information, display the media generation area in the editing interface, wherein a parameter of at least one control in the media generation area is determined based on the reference information.

[0121] In some embodiments, the parameter editing module 420 is further configured to: obtain, via a first input control of the first split-screen component, a description text of the split-screen; and / or obtain, via a second input control of the first split-screen component, reference material of the split-screen.

[0122] In some embodiments, the split-screen display module 410 is further configured to: display at least one generation portal in the first split-screen component; and in response to a selection of a target generation portal in the at least one generation portal, display the media generation area in the editing interface.

[0123] In some embodiments, the at least one generation portal is determined based on the reference information.

[0124] In some embodiments, the apparatus 400 further includes an image display module configured to, in response to generating the first split-screen clip, display a video frame in the first split-screen clip in the first split-screen component.

[0125] In some embodiments, the apparatus 400 further includes an editing portal display module configured to, in response to generating the first split-screen clip, display a first set of editing portals in the first split-screen component, the first set of editing portals including a first re-editing portal; and in response to a selection of the first re-editing portal, display parameter information used to generate the first split-screen clip in the media generation area.

[0126] In some embodiments, the split shot generation module 430 is further configured to regenerate the first split shot segment corresponding to the first split shot component based on the second parameter information obtained in the media generation area.

[0127] In some embodiments, the split shot generation module 430 is further configured to, in response to the selection of the first video generation entry, display the media generation area; and generate the first video content corresponding to the first split shot component based on third parameter information obtained in the media generation area, the third parameter information comprising at least one reference image, the at least one reference image comprising picture materials.

[0128] In some embodiments, the apparatus 400 further comprises a split shot material display module configured to display, in a material management area of the editing interface, at least one split shot material generated based on the parameter information, the at least one split shot material comprising the first split shot segment.

[0129] In some embodiments, the material management area comprises a first viewing entry, and the split shot material display module is further configured to, in response to the selection of the first viewing entry, display, in the material management area, all materials associated with the media content, the all materials comprising the generated materials and / or the uploaded materials.

[0130] In some embodiments, the material management area comprises a second viewing entry, and the split shot material display module is further configured to, in response to the selection of the first split shot component, display, in the material management area, a group of materials associated with the first split shot component, the group of materials comprising the at least one split shot material generated based on the parameter information.

[0131] In some embodiments, the apparatus 400 further comprises a generation entry presentation module configured to, in response to the selection of the image material in the material management area, present a second video generation entry, the second video generation entry being used to trigger the generation of a second video content based on the image material.

[0132] In some embodiments, the apparatus 400 further comprises a re-edit entry presentation module configured to, in response to the selection of the at least one split shot material in the material management area, present a second re-edit entry; and in response to the selection of the second re-edit entry, display, in the media generation area, the parameter information used to generate the first split shot segment.

[0133] In some embodiments, the apparatus 400 further comprises a split shot segment creation module configured to, based on the selection of a target material in the material management area, create a second split shot segment corresponding to the target material; and display, in the split shot editing area, a second split shot component corresponding to the second split shot segment.

[0134] In some embodiments, the apparatus 400 further includes an edit entry display module configured to display, in the content preview area of the edit interface, a second set of edit entries for editing the first split screen segment.

[0135] In some embodiments, the split screen editing area further includes a third split screen component corresponding to a third split screen segment, the third split screen component being adjacent to the first split screen component, and the apparatus 400 further includes a video generation entry display module configured to: in response to a selection of the first split screen component and the third split screen component, present a third video generation entry; and in response to a selection of the third video generation entry, generate a third video content based on the first split screen segment and the third split screen segment to replace the first split screen segment and the third split screen segment.

[0136] In some embodiments, the first split screen segment corresponds to a first image material, the third split screen segment corresponds to a second image material, and the first frame and the last frame of the third video content are determined based on the first image material and the second image material, respectively.

[0137] In some embodiments, the apparatus 400 further includes an edit operation receiving module configured to: receive an edit operation for the first split screen component, the edit operation being used to modify a size of the first split screen component to indicate an extension of a time length of the first split screen segment; and generate a second set of video frames corresponding to a blank segment in the first split screen segment based on a first set of video frames in the first split screen segment.

[0138] In some embodiments, the apparatus 400 further includes a split screen adjustment module configured to: based on a move operation for the first split screen component, adjust a component order of the first split screen component in the split screen editing area; and adjust an order of the first split screen segment in the media content to be generated.

[0139] In some embodiments, the split screen editing area displays a first number of split screen components in a plurality of split screen components, the plurality of split screen components corresponding to a plurality of split screen segments of the media content to be generated, and the apparatus 400 further includes a split screen component display module configured to: in response to receiving a viewing request, stop displaying the content preview area in the edit interface, and display, in the edit interface, a split screen viewing area displaying a second number of split screen components in the plurality of split screen components, the second number being greater than the first number.

[0140] In some embodiments, the apparatus 400 further includes an audio adding module configured to: in response to a request of adding a target audio content, present an audio track corresponding to the target audio content in the split screen editing area.

[0141] In some embodiments, the apparatus 400 further includes a track display module configured to, in response to receiving the track viewing request, present the plurality of tracks in the editing interface, the plurality of tracks including the breakdown track for presenting the at least one breakdown segment and the at least one audio track corresponding to the added at least one item of audio content.

[0142] The units included in the apparatus 400 can be implemented with various means including software, hardware, firmware, or any combination of these. In some embodiments, one or more units can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units in the apparatus 400 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.

[0143] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the electronic device 110 illustrated in FIG. 1.

[0144] As shown in FIG. 5, the electronic device 500 is in the form of a general electronic device. Components of the electronic device 500 can include, but are not limited to, one or more processing units or processors 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 520. In a multi-processor system, multiple processors perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0145] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and nonvolatile media, removable and non-removable media. The memory 520 can be volatile (such as register, cache, RAM), non-volatile (such as ROM, EEPROM, flash memory), or some combination of the two. The storage device 530 can be a removable or non-removable media, and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be used to store information and / or data (e.g., training data for training) and that can be accessed by the electronic device 500.

[0146] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non- volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0147] The communication unit 540 enables communication with other electronic devices over communication media. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communication over a communication connection. Thus, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.

[0148] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 540, as needed, one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0149] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0150] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0151] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0152] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0153] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk drive, or any other suitable non-transitory computer readable medium can store the computer program product.

[0154] Having described several implementations of the present disclosure, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The implementation described herein is implementations of the present disclosure. Other implementations of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the present disclosure. Therefore, this disclosure is intended to cover all such modifications and variations as fall within the scope of the implementations. It is intended that the specification and depicted embodiments are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A media editing method, comprising: The first storyboard component is displayed in the storyboard editing area of ​​the editing interface; In response to receiving a preset operation in the first storyboard component, a media generation area is displayed in the editing interface; Based on the parameter information obtained in the media generation area, a first storyboard segment corresponding to the first storyboard component is generated; as well as The first storyboard segment is displayed in the content preview area of ​​the editing interface.

2. The method according to claim 1, wherein displaying the first storyboard component in the storyboard editing area of ​​the editing interface includes: Receive the selection of a creation entry point in the storyboard editing area; as well as In response to the selection, the first storyboard component is displayed in the editing interface.

3. The method of claim 1, wherein displaying the media generation area in the editing interface in response to receiving a preset operation in the first storyboard component comprises: Reference information for generating storyboard segments is obtained via the first storyboard component; as well as In response to receiving a generation request associated with the reference information, the media generation area is displayed in the editing interface, wherein the parameters of at least one control in the media generation area are determined based on the reference information.

4. The method of claim 3, wherein obtaining reference information for generating storyboard segments via the first storyboard component includes: The descriptive text of the storyboard is obtained through the first input control of the first storyboard component; and / or Reference material for the storyboard is obtained through the second input control of the first storyboard component.

5. The method of claim 3, wherein displaying the media generation area in the editing interface in response to receiving a generation request associated with the reference information comprises: At least one generation entry is displayed in the first storyboard component; as well as In response to the selection of a target generation entry in the at least one generation entry, the media generation area is displayed in the editing interface.

6. The method of claim 5, wherein the at least one generation entry is determined based on the reference information.

7. The method according to claim 1, further comprising: In response to generating the first storyboard segment, video frames from the first storyboard segment are displayed in the first storyboard component.

8. The method according to claim 1, further comprising: In response to generating the first storyboard segment, a first set of editing entry points is displayed in the first storyboard component, the first set of editing entry points including a first re-edit entry point; as well as In response to the selection of the first re-edit entry, the parameter information for generating the first storyboard segment is displayed in the media generation area.

9. The method according to claim 8, wherein the parameter information is first parameter information, and the method further comprises: Based on the second parameter information obtained in the media generation area, the first storyboard segment corresponding to the first storyboard component is regenerated.

10. The method according to claim 8, wherein the first storyboard segment corresponds to image material, and the first set of editing entry points further includes a first video generation entry point, the method further comprising: In response to the selection of the first video generation entry point, the media generation area is displayed; as well as Based on the third parameter information obtained in the media generation area, a first video content corresponding to the first storyboard component is generated to replace the first storyboard segment. The third parameter information includes at least one reference image, and the at least one reference image includes the image material.

11. The method according to claim 1, further comprising: At least one storyboard clip generated based on the parameter information is displayed in the material management area of ​​the editing interface, and the at least one storyboard clip includes the first storyboard segment.

12. The method according to claim 11, wherein the material management area includes a first viewing entry point, and the method further includes: In response to the selection of the first viewing entry, all materials associated with the media content are displayed in the material management area, including generated materials and / or uploaded materials.

13. The method according to claim 11, wherein the material management area includes a second viewing entry point, and the method further includes: In response to the selection of the first storyboard component, a set of footage associated with the first storyboard component is displayed in the footage management area, the set of footage including the at least one storyboard footage generated based on the parameter information.

14. The method of claim 11, further comprising: In response to the selection of image material in the material management area, a second video generation entry is presented, which is used to trigger the generation of second video content based on the image material.

15. The method of claim 11, further comprising: In response to the selection of at least one storyboard material in the material management area, a second re-editing entry is presented; as well as In response to the selection of the second re-edit entry, the parameter information used to generate the first storyboard segment is displayed in the media generation area.

16. The method of claim 11, further comprising: Based on the selection of target material in the material management area, a second storyboard segment corresponding to the target material is created; as well as The second storyboard component corresponding to the second storyboard segment is displayed in the storyboard editing area.

17. The method according to claim 1, further comprising: A second set of editing entries for editing the first storyboard segment is displayed in the content preview area of ​​the editing interface.

18. The method of claim 1, wherein the storyboard editing area further includes a third storyboard component corresponding to the third storyboard segment, the third storyboard component being adjacent to the first storyboard component, and the method further includes: In response to the selection of the first storyboard component and the third storyboard component, a third video generation entry point is presented; as well as In response to the selection of the third video generation entry, a third video content is generated based on the first storyboard segment and the third storyboard segment to replace the first storyboard segment and the third storyboard segment.

19. The method of claim 18, wherein the first storyboard segment corresponds to a first image material, the third storyboard segment corresponds to a second image material, and the first frame and the last frame of the third video content are determined based on the first image material and the second image material, respectively.

20. The method according to claim 1, further comprising: Receive an editing operation on the first storyboard component, the editing operation being used to modify the size of the first storyboard component to indicate an extension of the duration of the first storyboard segment; and Based on the first set of video frames in the first storyboard segment, a second set of video frames corresponding to the blank segments in the first storyboard segment is generated.

21. The method according to claim 1, further comprising: Based on the movement operation of the first storyboard component, the component order of the first storyboard component in the storyboard editing area is adjusted; as well as Adjust the order of the first storyboard segment in the media content to be generated.

22. The method of claim 1, wherein the storyboard editing area displays a first number of storyboard components from a plurality of storyboard components, the plurality of storyboard components corresponding to a plurality of storyboard segments of media content to be generated, the method further comprising: In response to receiving a viewing request, the content preview area is stopped from being displayed in the editing interface, and a storyboard viewing area is displayed in the editing interface. The storyboard viewing area displays a second number of storyboard components among the plurality of storyboard components, and the second number is greater than the first number.

23. The method according to claim 1, further comprising: In response to a request to add target audio content, an audio track corresponding to the target audio content is presented in the storyboard editing area.

24. The method according to claim 1, further comprising: In response to receiving a track viewing request, multiple tracks are presented in the editing interface, including a storyboard track for presenting at least one storyboard segment and at least one audio track corresponding to at least one piece of added audio content.

25. An apparatus for media editing, comprising: The storyboard display module is configured to display the first storyboard component in the storyboard editing area of ​​the editing interface; The parameter editing module is configured to display a media generation area in the editing interface in response to receiving a preset operation in the first storyboard component; The storyboard generation module is configured to generate a first storyboard segment corresponding to the first storyboard component based on parameter information obtained in the media generation area. as well as The storyboard preview module is configured to display the first storyboard segment in the content preview area of ​​the editing interface.

26. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 24 when executed by the at least one processor.

27. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method according to any one of claims 1 to 24.

28. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 24.

Images