Media editing method and apparatus, device and storage medium

Abstract

Embodiments of the present disclosure relate to a media editing method and apparatus, a device, and a storage medium. The method comprises: in response to triggering a generation entry on an editing interface, presenting at least one media template; in response to selecting a first media template among the at least one media template, presenting a configuration panel; via the configuration panel, determining configuration information, the configuration information at least comprising text content; and, on the editing interface, adding at least one material generated on the basis of the first media template and the configuration information, the at least one material comprising audio content and animation content that correspond to the text content, the animation content comprising a dynamic process of a virtual object, and the dynamic process corresponding to the audio content. In this way, the embodiments of the present disclosure can quickly add media materials associated with virtual objects, thereby improving media editing efficiency.

Description

Media editing methods, apparatus, equipment and storage media

[0001] This application claims priority to Chinese Patent Application No. 202510344934.5, filed on March 21, 2025, entitled "Media Editing Method, Apparatus, Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to media editing methods, apparatus, devices, and computer-readable storage media. Background Technology

[0003] With the development of computer technology, people can share or access media content through internet platforms. Media editing tools have also gradually become important tools in people's lives; for example, people can use media editing tools to generate or edit video content and share it through media platforms. Summary of the Invention

[0004] In a first aspect of this disclosure, a media editing method is provided. The method includes: presenting at least one media template in response to triggering an entry point generation in an editing interface; presenting a configuration panel in response to selecting a first media template from the at least one media template; determining configuration information via the configuration panel, the configuration information including at least text content; and adding at least one material generated based on the first media template and the configuration information to the editing interface, wherein the at least one material includes audio content and visual content corresponding to the text content, the visual content including a dynamic process of a virtual object, the dynamic process corresponding to the audio content.

[0005] In a second aspect of this disclosure, an apparatus for media editing is provided. The apparatus includes: a template presentation module, a template configuration module, a parameter generation module, and a material addition module, wherein the template presentation module is configured to present at least one media template in response to triggering a generation entry in the editing interface; the template configuration module is configured to present a configuration panel in response to selecting a first media template from the at least one media template; the parameter generation module is configured to determine configuration information via the configuration panel, the configuration information including at least text content; and the material addition module is configured to add at least one material generated based on the first media template and the configuration information in the editing interface, wherein the at least one material includes audio content and visual content corresponding to the text content, the visual content including a dynamic process of a virtual object, the dynamic process corresponding to the audio content.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the method of the first aspect.

[0008] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0010] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

[0011] Figures 2A to 2G illustrate example interfaces according to some embodiments of the present disclosure;

[0012] Figure 3 illustrates a flowchart of an example process for media editing according to some embodiments of the present disclosure;

[0013] Figure 4 shows a schematic structural block diagram of an example device for media editing according to some embodiments of the present disclosure; and

[0014] Figure 5 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0015] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0016] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0017] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0018] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0019] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0020] As mentioned above, media editing tools have gradually become important tools in people's lives. For example, people can use media editing tools to edit video content and share it through media platforms.

[0021] In the traditional editing process or before editing, people usually need to collect the necessary materials themselves, such as choosing suitable scenes or backgrounds, selecting suitable on-camera personnel and their clothing and decorations, in order to shoot satisfactory video materials, which greatly affects the efficiency of media editing.

[0022] Embodiments of this disclosure propose a media editing scheme. The scheme includes: presenting at least one media template in response to triggering an entry point in an editing interface; presenting a configuration panel in response to selecting a first media template from the at least one media template; determining configuration information via the configuration panel, the configuration information including at least text content; and adding at least one material generated based on the first media template and the configuration information to the editing interface, wherein the at least one material includes audio content and visual content corresponding to the text content, the visual content including a dynamic process of a virtual object, the dynamic process corresponding to the audio content.

[0023] In this way, embodiments of the present disclosure can provide at least one media template and obtain configuration information including text content through a configuration panel. Then, it can add materials such as audio content and video content corresponding to the text content in the editing interface. The video content includes the dynamic process of virtual objects corresponding to the audio content, thereby quickly generating video materials and adding them in the editing interface. This can greatly improve the diversity and efficiency of adding media materials, improve media editing efficiency, and enhance user experience.

[0024] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0025] Example Environment

[0026] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0027] In this example environment 100, electronic device 110 may run an application 120 that supports media editing. Application 120 may be any suitable type of application for media editing, and examples may include, but are not limited to, audio / video sharing applications, media editing applications, or other suitable applications that can provide media editing services. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0028] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can present interface 150 for supporting media editing through application 120.

[0029] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0030] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for the media editing application 120 in electronic device 110.

[0031] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0032] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0033] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0034] Example Interaction

[0035] The following description refers to Figures 2A to 2G to illustrate example interaction processes according to embodiments of the present disclosure. Figures 2A to 2G show example interfaces 200A to 200G according to some embodiments of the present disclosure. Interfaces 200A to 200G may be provided, for example, by the electronic device 110 shown in Figure 1.

[0036] Referring to FIG2A, FIG2A illustrates an example editing interface 200A according to some embodiments of the present disclosure. As an example, electronic device 110 may provide media editing interface 200A. For example, electronic device 110 may present example editing interface 200A based on the response to operations of its installed application 120, or based on the response to at least one operation of application 120.

[0037] As an example, the editing interface 200A can also be called a multi-track editing interface to support users in editing materials on different tracks of a video draft, such as video tracks, image tracks, audio tracks, effects tracks, etc.

[0038] In some embodiments, the electronic device 110 may provide at least one editing entry in the editing interface 200A to add corresponding media materials to the editing track of the editing interface 200A via the editing entry.

[0039] As shown in Figure 2A, the electronic device 110 provides at least a generation entry 210 in the editing interface 200A. In response to the triggering of the generation control 210, the electronic device 110 can present at least one media template, as shown in the interface 200B in Figure 2B.

[0040] Referring to Figure 2B, the electronic device 110 can present a template panel 220 based on a triggering of the generation entry 210, in which at least one media template is provided. Taking the first template 225 among the at least one media template as an example, any media template may include a virtual object. As an example, the virtual object may include a digital human.

[0041] In some embodiments, the media template may include a digital human template, for example, a media template containing a preset digital human image.

[0042] In some embodiments, the media template may also include a digital human image template, for example, a media template containing at least one preset digital human image.

[0043] In some embodiments, the media template may also include a customized image template, such as a media template containing image elements corresponding to at least one digital human.

[0044] As shown in Figure 2B, at least one template type label 220a can be provided in the template panel 220. As an example, the template type label 220a may include at least one of the following: digital human template, digital human avatar, customized avatar, etc.

[0045] Taking the digital human template as an example, the template type tag 220a can also include at least two template theme tags 220b, such as knowledge, festivals, and information.

[0046] Taking the first media template 225 in at least one media template as an example, the electronic device 110 can display information such as the media cover and content name of the first media template 225 in the template panel 220.

[0047] As shown in Figure 2B, the electronic device 110 can also display a first generation control 225a at a cover-related position (e.g., at the bottom or below the media cover) of the first media template 225. The first generation control 225a can serve as an application control or playback control for the first media template 225.

[0048] In some embodiments, the electronic device 110 may present a playback interface of the first media template 225 based on the triggering of the first generation control 225a.

[0049] In some embodiments, the electronic device 110 may present a media creation interface or media configuration panel based on the first media template 225 based on the triggering of the first generation control 225a.

[0050] In some embodiments, the electronic device 110 presents a preview interface of the first media template 225 based on a trigger of the first media template 225, such as interface 200C shown in FIG2C. As an example, the electronic device 110 may present a playback interface of the first media template 225 based on a trigger of the media cover or reference name of the first media template 225.

[0051] Referring to Figure 2C, within the playback interface 200C, the electronic device 110 can play the media content of the first media template 225 frame by frame, so that the user can view the specific media content of the first media template 225.

[0052] As an example, within the playback interface 200C, the electronic device 110 can also display the content name, description information, and other related information of the media content 225.

[0053] As shown in Figure 2C, within the playback interface 200C, the electronic device 110 also provides a second generation control 225b as an application control for the first media template 225. Users can trigger the second generation control 225b to transform the currently playing first media template 225 within the playback interface 200C into a work, that is, to apply the media template 225 for media editing or creation, such as audio content, visual content, text content, and other media materials.

[0054] In some embodiments, the electronic device 110 may present a configuration panel based on the first media template 225 based on the triggering of the first generation control 225a in the interface 200B, or based on the triggering of the second generation control 225b in the interface 200C. For example, the electronic device 110 may present the interface 200D shown in FIG2D.

[0055] Referring to Figure 2D, the electronic device 110 presents a configuration panel 230 based on the first media template 225 in the interface 200D. Through the configuration panel 230, the electronic device 110 can receive at least one piece of configuration information from the user, thereby determining the configuration information associated with the first media template 225, and generating corresponding media content or at least one element of the media content based on the configuration information.

[0056] In some embodiments, the electronic device 110 presents at least one configuration control in the configuration panel 230, such as a configuration control 231a for the broadcast content and a avatar-changing configuration control 231b for the virtual object avatar.

[0057] As an example, via the broadcast content configuration control 231a, the electronic device 110 can receive at least one configuration operation from the user regarding the broadcast content, thereby determining at least one configuration piece of information for the broadcast content, such as the broadcast text and broadcast tone. via the virtual object image changing configuration control 231b, the electronic device 110 can receive at least one configuration piece of information from the user regarding the virtual object image, thereby determining the configuration information for the image of the virtual object in the first media template 225. For example, the first virtual object corresponding to the first media template 225 can be replaced with a second virtual object determined based on the configuration information.

[0058] As shown in Figure 2D, for the broadcast content configuration control 231a, the electronic device 110 can provide at least one content type control, such as a text input control 232a and an audio input control 232b. As an example, the text input control 232a can be presented in the configuration panel 230 as "Script", "Input Text", "Input Text", etc., and the audio input control 232b can be presented as "Upload Audio", "Input Voice", etc., without limitation.

[0059] As an example, electronic device 110 can receive reference text input by a user via text input control 232a. Electronic device 110 can directly use the received reference text as text content, or it can obtain text content based on the received reference text using a pre-configured generative model. The text content is text that the user can add to media content. For example, electronic device 110 can use the text content as one of the materials used to generate media content, or it can use it as one of the configuration information for generating materials.

[0060] As an example, via audio input control 232b, electronic device 110 can receive reference audio uploaded by a user and determine the corresponding text content based on the reference audio. For example, electronic device 110 performs speech recognition and text generation on the reference audio to obtain the corresponding reference text. As another example, electronic device 110 can input the reference audio into a pre-configured recognition model to obtain the corresponding text content.

[0061] As shown in Figure 2D, the electronic device 110 can also display a preview box 233 corresponding to the content type option in the configuration panel 230. Through the preview box 233, the electronic device 110 can display the indicator elements corresponding to the received reference text / or reference audio, such as displaying the file identifier corresponding to the text content or audio file.

[0062] In some embodiments, the electronic device 110 may also display a subtitle generation control 234 in a configuration panel 230. Based on whether the subtitle generation control 234 is selected, the electronic device 110 can determine the generation parameters for the generated subtitles.

[0063] As an example, in response to the selection of the subtitle generation control 234, the electronic device 110 can determine that the material generated based on the first media template 225 includes subtitle content, and based on the text content determined in the aforementioned process, determine the subtitle content corresponding to the text content. The subtitle style of the subtitle content can be the same as the subtitle style in the first media template 225.

[0064] In some embodiments, the electronic device 110 may also provide a tone control 235 in the configuration panel 230. In response to triggering the tone control 235, the electronic device 110 may present a preset set of sound styles.

[0065] Referring to Figure 2E, the electronic device 110 can present at least one indicator element 235a corresponding to at least one sound style based on the triggering of the timbre control 235.

[0066] As an example, the indicator element 235a corresponding to the sound style may include an image icon and a style name. The style name may include a little girl, a little boy, a gentle girl, a deep male voice, an anime character, etc. The image icon may be a virtual image corresponding to the style name.

[0067] In response to the selection of a target indicator element from a set of indicator elements 235a, the electronic device 110 uses the sound style indicated by the target indicator element as at least part of the sound configuration information corresponding to the audio content.

[0068] As shown in Figure 2E, the electronic device 110 can also display a subtitle keyword control 236 in the configuration panel 230. For example, "Subtitle highlighting".

[0069] In some embodiments, in response to the activation of the subtitle keyword control 236, the electronic device 110 determines a set of keywords from the text content and determines the first subtitle style corresponding to the set of keywords based on the subtitle style corresponding to the keywords in the first media template 225.

[0070] Based on this, the electronic device 110 applies the first subtitle style to the generated subtitle content corresponding to the text content.

[0071] In some embodiments, text other than keywords in the text content is presented in the subtitle content in a second subtitle style that differs from the first subtitle style. As an example, the second subtitle style may be the presentation style used for subtitles other than keywords in the first media template 225.

[0072] In some embodiments, in response to the subtitle keyword 236 being turned off, the electronic device 110 can determine the subtitle style in the first media template 225 as the presentation style corresponding to the subtitle content generated based on the text content.

[0073] Referring to Figure 2F, the electronic device 110 can also present a set of virtual images 237 in the configuration panel 230 based on the triggering of the image swapping configuration control 231b.

[0074] In some embodiments, in response to the selection of a target virtual avatar 237a in a set of virtual avatars 237, the electronic device 110 may replace the current virtual avatar corresponding to the first media template 225 with the target virtual avatar 237a, and determine the second virtual object and avatar parameters indicated by the target virtual avatar, so as to use the avatar parameters as one of the generation parameters of the media material.

[0075] Based on the operations received from the configuration controls, electronic device 110 can determine at least one piece of configuration information, such as text content, audio content, subtitle content, subtitle style, keyword style, virtual object image parameters, and action information. Then, based on this configuration information, it can combine it with the first media template 225 to generate at least one corresponding media material.

[0076] Referring to Figures 2D-2F, the electronic device 110 provides a media generation control 238 in the configuration panel 230. In response to the triggering of the media generation control 238, the electronic device 110 can generate at least one media material by combining the configuration information determined above and the first media template 225.

[0077] In some embodiments, a generative model deployed on electronic device 110 or server 130 may be used to generate at least one media material based on the above configuration information.

[0078] As an example, at least one media material generated may include audio and video content corresponding to text content, and may also include subtitle content, etc.

[0079] In some embodiments, the screen content includes the dynamic process of a virtual object, which corresponds to the audio content. For example, the screen content may include the facial movement process of the virtual object, such as dynamic changes in lip shape, eyelids, and cheeks in response to the audio content; it may also include the limb movement process of the virtual object, such as changes in body posture, gestures, and head position. The virtual object may include a virtual digital human or animal.

[0080] In some embodiments, the electronic device 110 can directly add at least one generated media material to the editing track of the editing interface, such as the editing interface 200G shown in Figure 2G.

[0081] In some embodiments, based on the triggering of the media generation control 238, the electronic device 110 may also present an information confirmation panel before presenting the editing interface, to display a prompt message and a confirmation control. As an example, the prompt message may be a prompt message indicating the virtual points required to generate the media. In response to the triggering of the confirmation control, the electronic device 110 generates at least one more media piece and adds it to the editing track of the editing interface.

[0082] Referring to Figure 2G, the editing interface 200G includes a preview area 240, a track area 250, and an editing area 260. The preview area 240 allows previewing media materials or media content composed of media materials in the current editing interface. The track area 250 presents at least one editing track to display at least one piece of material used to create the media content. This may include user-added original material, such as material 251, or material generated based on a first media template, such as material 252 and material 253. The editing area 260 presents at least one editing control for editing at least one piece of material in the track area 250.

[0083] In some embodiments, the electronic device 110 can directly add at least one generated media material to the track area 250 and display it on the corresponding editing track. Furthermore, it can edit each media material based on at least one editing control in the editing area 260.

[0084] In some embodiments, the material 252 generated by the electronic device 110 may include audio content and video content.

[0085] As an example, the audio content is associated with the sound style configured via the timbre control 235 in the configuration panel 230.

[0086] As an example, the content of the screen can be associated with the first virtual object corresponding to the first media template 225, or it can be associated with the second virtual object indicated by the configuration information of the image change configuration control 231b in the configuration panel 230.

[0087] In some embodiments, material 252 may also include caption content. The presentation style of this caption content is associated with the caption style in the first media template 225.

[0088] In some embodiments, the first media template 225 may be a real-scene template or a green screen template.

[0089] Taking the real-scene template as an example, its virtual object and template background are an integrated structure. In the material generated based on the real-scene template, the virtual object and background image are presented in the same material in the editing track.

[0090] Taking the green screen template as an example, its virtual object and template background are independent materials. In the materials generated based on the green screen background, the virtual object and background image can be presented in different materials in the editing track.

[0091] As shown in Figure 2G, taking the green screen template as an example, the generated material 252 is the animation material corresponding to the virtual object, and the material 253 can be the background material corresponding to the background image.

[0092] In this solution, the electronic device 110 can receive editing operations on the material 252 in the editing interface 200G, such as adding filters, adjusting colors, adding stickers, etc.; it can also receive editing operations on the material 253, such as replacing the material 253 to replace the background image corresponding to the screen content.

[0093] As shown in Figure 2G, the electronic device 110 also generates a control 270 in the editing interface 200G. In response to the triggering of the generated control 270, the electronic device 110 can generate corresponding video content based on the materials and editing operations within the editing interface 200G to complete the media editing process.

[0094] Virtual object driver

[0095] In some embodiments, electronic device 110 or server 130 may determine audio control signals based on text content and may provide the generative model with images of virtual objects to be used (e.g., virtual objects corresponding to media templates or virtual objects selected by the user) and audio control signals to generate video content.

[0096] Specifically, an audio generation model can be used to generate audio content corresponding to a preset timbre based on the broadcast text. As an example, the preset timbre could be the timbre used in a media template. Alternatively, the preset timbre could be another timbre selected by the user. Furthermore, the generated audio content can provide audio control signals as a generative model to drive virtual objects.

[0097] In some embodiments, the model may include multiple attention layers. The attention layers may include multimodal attention units. Specifically, where the control signal includes audio content, audio features of the audio content can be determined. As an example, audio features may include Mel-spectral features of the audio content. Further, an encoding unit may be used to process the audio features to obtain audio tokens. As an example, the encoding unit may include, for example, a multilayer perceptron (MLP) or other suitable model.

[0098] Furthermore, the cross-attention unit can update the model's input video features based on the cross-attention mechanism and audio tokens. The updated input video features can then be provided to the multimodal attention unit in the next attention layer. In this way, after processing through multiple attention layers, the model can output the final video features to generate the final video content.

[0099] Example process

[0100] Figure 3 shows a flowchart of an example process 300 for media editing according to some embodiments of the present disclosure. Process 300 can be implemented at an electronic device 110. Process 300 will now be described with reference to Figure 1.

[0101] As shown in Figure 3, in box 310, electronic device 110 responds to the triggering of an entry point in the editing interface by presenting at least one media template.

[0102] As an example, the editing interface can refer to the editing interface 200A shown in Figure 2A, the generation entry can refer to the generation entry 210 in Figure 2A, and at least some media templates can refer to the media templates shown in Figure 2B.

[0103] Referring again to Figure 3, in box 320, electronic device 110 presents a configuration panel in response to the selection of a first media template among at least one media template.

[0104] As an example, the first media template can refer to the first media template 225 shown in Figure 2B, and the configuration panel can refer to the configuration panel 230 shown in Figures 2D and 2E.

[0105] Referring again to Figure 3, in box 330, electronic device 110 determines configuration information via a configuration panel, which includes at least text content.

[0106] In frame 340, electronic device 110 adds at least one material generated based on the first media template and configuration information in the editing interface. The at least one material includes audio content and visual content corresponding to the text content. The visual content includes the dynamic process of a virtual object, which corresponds to the audio content.

[0107] As an example, at least one material can be referenced from material 252 and material 253 shown in Figure 2G.

[0108] In this way, the present disclosure embodiments can provide at least one media template and obtain configuration information including text content through the configuration panel. Then, it can add materials such as audio content and video content corresponding to the text content in the editing interface. The video content includes the dynamic process of virtual objects corresponding to the audio content, thereby quickly generating video materials and adding them in the editing interface. This can greatly improve the diversity and efficiency of adding media materials, improve media editing efficiency, and enhance user experience.

[0109] In some embodiments of this disclosure, the virtual object includes a first virtual object corresponding to a first media template; or a second virtual object indicated by configuration information.

[0110] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: obtaining text content via a text input control in the configuration panel; or obtaining reference audio via an audio input control in the configuration panel to determine text content corresponding to the reference audio.

[0111] As an example, the text input control can refer to the "Text Script" control 232a shown in Figure 2D, and the audio input control can refer to the "Upload Audio" control 232b shown in Figure 2D.

[0112] In this way, the embodiments of this disclosure can determine text content based on text input controls or audio input controls, expand the file types and methods for determining text content, and improve the efficiency of determining text content.

[0113] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: presenting a set of sound styles in the configuration panel; and receiving a selection of a first sound style from the set of sound styles, wherein the first generation style is used to generate audio content corresponding to the text content.

[0114] As an example, the sound style can be referenced to sound style 235a shown in Figure 2E.

[0115] In this way, the embodiments of this disclosure can select and configure the sound style of audio content, effectively expand the sound style of audio content, diversify the selection of sound style of audio content, and improve user experience.

[0116] In some embodiments of this disclosure, at least one material also includes subtitle content corresponding to the text content, and the subtitle style of the subtitle content is determined based on the first media template.

[0117] In this way, the embodiments of this disclosure can quickly determine the subtitle content and its style corresponding to the text content based on the first media template, thereby improving the richness of the material and enhancing the user experience.

[0118] In some embodiments of this disclosure, the subtitle content is generated based on the following process: determining a set of keywords from the text content; determining a first subtitle style corresponding to the set of keywords based on a first media template; and generating subtitle content corresponding to the text content, wherein the set of keywords is applied to the first subtitle style.

[0119] In this way, the embodiments of this disclosure can quickly locate keywords from text content and highlight the keywords in the style of a first subtitle, thereby improving the eye-catching effect of the keywords, helping users to quickly identify the keywords, and enhancing the user experience.

[0120] In some embodiments of this disclosure, a portion of the text content other than a set of keywords is applied with a second subtitle style, which is determined based on a first media template.

[0121] In this way, the embodiments of this disclosure can quickly distinguish the subtitle styles of keywords and other parts, thereby improving the efficiency of subtitle content generation.

[0122] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: presenting at least one virtual object in the configuration panel; and receiving a selection of a second virtual object from the at least one virtual object.

[0123] As an example, at least one virtual object can be presented based on the "Change Appearance" configuration control 231b shown in Figure 2D.

[0124] In this way, the embodiments of this disclosure can configure or replace the virtual object corresponding to the first media template, effectively expanding the application methods of the media template, diversifying the selection and configuration of virtual objects, enriching the content, and improving the user experience.

[0125] In some embodiments of this disclosure, at least one virtual object includes: a preset virtual object; and / or a virtual object created based on the current user's configuration operations.

[0126] In this way, embodiments of the present disclosure can select preset virtual objects or allow users to freely configure and create virtual objects, effectively expanding the diversity of virtual objects, enriching the content, and improving the user experience.

[0127] In some embodiments of this disclosure, process 300 further includes: electronic device 110 receiving editing operations on at least one material in an editing interface.

[0128] In this way, the embodiments of this disclosure can edit the generated materials, expand the presentation effect of the materials, and improve the user experience.

[0129] In some embodiments of this disclosure, the editing operation includes: replacing the background image corresponding to the content of the screen.

[0130] In this way, the embodiments of this disclosure can replace the background image corresponding to the screen content, effectively expanding the configuration methods of the background image and improving the user experience.

[0131] In some embodiments of this disclosure, process 300 further includes: electronic device 110 generating video content based on at least one source material.

[0132] In this way, embodiments of the present disclosure can quickly generate video content based on at least one of the generated materials, thereby improving the efficiency of video content generation and enhancing the user experience.

[0133] Example devices and equipment

[0134] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 shows a schematic structural block diagram of an example apparatus 400 for media editing according to certain embodiments of this disclosure. Apparatus 400 may be implemented as or included in electronic device 110. The various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0135] As shown in Figure 4, the device 400 includes: a template presentation module 410, a template configuration module 420, a parameter generation module 430, and a material addition module 440. The template presentation module 410 is configured to present at least one media template in response to triggering a generation entry in the editing interface; the template configuration module 420 is configured to present a configuration panel in response to selecting a first media template from the at least one media template; the parameter generation module 430 is configured to determine configuration information via the configuration panel, the configuration information including at least text content; and the material addition module 440 is configured to add at least one material generated based on the first media template and the configuration information in the editing interface, wherein the at least one material includes audio content and visual content corresponding to the text content, the visual content including a dynamic process of a virtual object, the dynamic process corresponding to the audio content.

[0136] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: obtaining text content via a text input control in the configuration panel; or obtaining reference audio via an audio input control in the configuration panel to determine text content corresponding to the reference audio.

[0137] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: presenting a set of sound styles in the configuration panel; and receiving a selection of a first sound style from the set of sound styles, wherein the first generation style is used to generate audio content corresponding to the text content.

[0138] In some embodiments of this disclosure, at least one material also includes subtitle content corresponding to the text content, and the subtitle style of the subtitle content is determined based on the first media template.

[0139] In some embodiments of this disclosure, the subtitle content is generated based on the following process: determining a set of keywords from the text content; determining a first subtitle style corresponding to the set of keywords based on a first media template; and generating subtitle content corresponding to the text content, wherein the set of keywords is applied to the first subtitle style.

[0140] In some embodiments of this disclosure, a portion of the text content other than a set of keywords is applied with a second subtitle style, which is determined based on a first media template.

[0141] In some embodiments of this disclosure, determining configuration information via a configuration panel includes: presenting at least one virtual object in the configuration panel; and receiving a selection of a second virtual object from the at least one virtual object.

[0142] In some embodiments of this disclosure, at least one virtual object includes: a preset virtual object; and / or a virtual object created based on the current user's configuration operations.

[0143] In some embodiments of this disclosure, the apparatus 400 further includes a material editing module configured to receive editing operations on at least one material in an editing interface.

[0144] In some embodiments of this disclosure, the editing operation includes: replacing the background image corresponding to the content of the screen.

[0145] In some embodiments of this disclosure, the apparatus 400 further includes a video generation module configured to generate video content based on at least one source material.

[0146] In the apparatus 400 provided in this embodiment, the specific processing procedures of each module and the technical effects they bring can be referred to the relevant description of the example process 300 above, and will not be repeated here.

[0147] As shown in Figure 5, the electronic device 500 is in the form of a general-purpose electronic device. Components of the electronic device 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in the memory 520. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0148] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0149] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0150] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0151] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0152] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0153] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0154] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0155] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0156] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0157] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A media editing method, comprising: In response to a triggering of an entry point in the editing interface, at least one media template is displayed; In response to the selection of a first media template from the at least one media template, a configuration panel is displayed; The configuration information is determined via the configuration panel, and the configuration information includes at least text content. as well as In the editing interface, at least one material generated based on the first media template and the configuration information is added, wherein the at least one material includes audio content and visual content corresponding to the text content, and the visual content includes the dynamic process of a virtual object, the dynamic process corresponding to the audio content.

2. The method according to claim 1, wherein, The virtual object includes: The first virtual object corresponding to the first media template; or The second virtual object indicated by the configuration information.

3. The method according to claim 1, wherein, The process of determining configuration information via the configuration panel includes: The text content is obtained via the text input control in the configuration panel; or A reference audio is obtained via the audio input control in the configuration panel to determine the text content corresponding to the reference audio.

4. The method according to claim 1, wherein, The process of determining configuration information via the configuration panel includes: A set of sound styles is presented in the configuration panel; and The system receives a selection of a first sound style from the set of sound styles, wherein the first sound style is used to generate the audio content corresponding to the text content.

5. The method according to any one of claims 1-4, wherein, The at least one material also includes subtitle content corresponding to the text content, and the subtitle style of the subtitle content is determined based on the first media template.

6. The method according to claim 5, wherein, The subtitle content was generated based on the following process: Identify a set of keywords from the text content; Based on the first media template, determine the first subtitle style corresponding to the set of keywords; as well as Generate subtitle content corresponding to the text content, wherein the set of keywords is applied to the first subtitle style.

7. The method according to claim 6, wherein, The portion of the text content other than the set of keywords is subject to a second subtitle style, which is determined based on the first media template.

8. The method according to any one of claims 1-4, 6 and 7, wherein, The process of determining configuration information via the configuration panel includes: At least one virtual object is presented in the configuration panel; and Receive a selection of the second virtual object from the at least one virtual object.

9. The method according to claim 8, wherein, The at least one virtual object includes: Preset virtual objects; and / or Virtual objects created based on the current user's configuration operations.

10. The method according to any one of claims 1-4, 6, 7 and 9, further comprising: In the editing interface, editing operations on the at least one material are received.

11. The method according to claim 10, wherein, The editing operations include: Replace the background image that corresponds to the content of the screen.

12. The method according to any one of claims 1-4, 6, 7, 9 and 11, further comprising: Based on at least one of the aforementioned materials, video content is generated.

13. An apparatus for media editing, comprising: The template rendering module is configured to render at least one media template in response to a triggering of an entry point generated in the editing interface; The template configuration module is configured to display a configuration panel in response to the selection of a first media template among the at least one media template; The parameter generation module is configured to determine configuration information via the configuration panel, the configuration information including at least text content; as well as The material adding module is configured to add at least one material generated based on the first media template and the configuration information in the editing interface, wherein the at least one material includes audio content and visual content corresponding to the text content, and the visual content is the dynamic process of the Boakai virtual object, which corresponds to the audio content.

14. An electronic device comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processing unit.

15. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 12.

Images