Media editing method and apparatus, device, and storage medium

By providing a music generation entry point and configuration window in the creation interface, the system generates and associates target music, solving the problem that users cannot create music on the online platform, and realizing the generation of user-defined music and the enhancement of media content.

WO2026026950A1PCT designated stage Publication Date: 2026-02-05BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/112128
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-08-02
Filing Date
2025-08-01
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

In existing technologies, users can only select existing music content on online platforms and cannot create music on the platform.

Method used

The creation interface presents a music generation entry point, responds to user selections, presents a music configuration window, generates target music based on the music generation request, and associates it with media content.

Benefits of technology

It provides users with the ability to generate music content, meets users' music configuration needs, and improves user experience and the quality of media content publishing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025112128_05022026_PF_FP_ABST
    Figure CN2025112128_05022026_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure relate to a media editing method and apparatus, a device, and a storage medium. The method proposed herein comprises: presenting a music generation entry in a creation interface; presenting a music configuration window in response to selection of the music generation entry; generating target music on the basis of a music generation request acquired by means of the music configuration window; and associating the target music with media content associated with the creation interface.
Need to check novelty before this filing date? Find Prior Art

Description

Media editing method, apparatus, device, and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411061103.9, filed on August 2, 2024, entitled “Media editing method, apparatus, device, and storage medium”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computer, and in particular, to a media editing method, apparatus, device, and computer readable storage medium. BACKGROUND

[0003] In recent years, with the rapid development of the Internet, more and more users edit and publish works in network platforms. For example, a user can add music to media content to be published in a network platform. SUMMARY

[0004] In a first aspect of the present disclosure, a media editing method is provided. The method comprises: presenting a music generation entry in a creation interface; presenting a music configuration window in response to a selection of the music generation entry; generating target music based on a music generation request obtained via the music configuration window; and associating the target music to media content associated with the creation interface.

[0005] In a second aspect of the present disclosure, an apparatus for media editing is provided. The apparatus comprises: a presentation module configured to present a music generation entry in a creation interface; a processing module configured to present a music configuration window in response to a selection of the music generation entry; a generation module configured to generate target music based on a music generation request obtained via the music configuration window; and an association module configured to associate the target music to media content associated with the creation interface.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer readable storage medium is provided. The computer readable storage medium has stored thereon computer executable instructions executable by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product includes computer executable instructions that, when executed by a processor, implement the method of the first aspect.

[0009] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the present disclosure or the present disclosure. Other features of the present disclosure will be apparent from the following description, the drawings, and the claims. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, wherein:

[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure can be implemented;

[0012] FIGS. 2A-2E show example interfaces according to some embodiments of the present disclosure;

[0013] FIGS. 3A-3C show example interfaces according to yet other embodiments of the present disclosure;

[0014] FIGS. 4A-4C show example interfaces according to yet other embodiments of the present disclosure;

[0015] FIG. 5 shows a flowchart of an example process of media editing according to some embodiments of the present disclosure;

[0016] FIG. 6 shows a schematic block diagram of an example apparatus for media editing according to some embodiments of the present disclosure; and

[0017] FIG. 7 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0018] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so as to more completely and thoroughly understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for exemplary purposes only and are not intended to limit the scope of the present disclosure.

[0019] It should be noted that the titles of any sections / sub-sections provided herein are not limiting. Various embodiments are described throughout this document and any type of embodiment can be included under any section / sub-section. Furthermore, embodiments described in any section / sub-section can be combined with any other embodiments described in the same section / sub-section and / or different section / sub-section in any manner.

[0020] In the description of embodiments of the disclosure, the term "includes" and its conjugates are open-ended, meaning "including but not limited to". The term "based on" is intended to mean "based, at least in part, on" The term "one embodiment" or "an embodiment" means "at least one embodiment". The term "some embodiments" means "at least some embodiments". Other explicit or implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or the same objects. Other explicit and implicit definitions can also be included below.

[0021] Embodiments of the disclosure can involve data of users, acquisition and / or use of data, etc. These aspects all comply with the corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, when implementing various embodiments of the disclosure, the type of data or information that can be involved, the scope of use, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained according to the relevant laws and regulations through appropriate means. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the disclosure is not limited in this regard.

[0022] In the specification and embodiments of the disclosure, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0023] As mentioned above, in recent years, with the rapid development of the Internet, more and more users edit and publish works in network platforms. For example, a user can add music to media content to be published in a network platform. In related technologies, when a user adds music in a network platform, only existing music content can be selected, and music cannot be created in the network platform.

[0024] Embodiments of the present disclosure propose a scheme of media editing. According to the scheme, a music generation entry can be presented in a creation interface; in response to a selection of the music generation entry, a music configuration window is presented; based on a music generation request acquired via the music configuration window, target music is generated; and the target music is associated to media content associated with the creation interface.

[0025] In this way, embodiments of the present disclosure are capable of providing an entry of generating music content in a creation interface, and acquiring a music generation request via a music configuration window corresponding to the entry, so as to generate target music based on the music generation request. Further, the target music can be associated to media content associated with the creation interface. Therefore, embodiments of the present disclosure are capable of providing a user with the ability of generating music based on configuration operation, meet the demand of the user for configuring music, and improve user experience.

[0026] Various example implementations of the scheme are described in further detail below in conjunction with the accompanying drawings.

[0027] Example Environment

[0028] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.

[0029] In this example environment 100, the electronic device 110 can run an application 120 that supports interface interaction. The application 120 can be any suitable type of application for interface interaction, examples of which can include, but are not limited to, a video application, a social application, or other suitable application. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices.

[0030] In the environment 100 of FIG. 1, if the application 120 is in an active state, the electronic device 110 can present an interface 150 for supporting interface interaction through the application 120.

[0031] In some embodiments, the electronic device 110 communicates with the server 130 to enable provisioning of services of the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media player, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) terminal, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an accessory or peripheral device for any of the foregoing, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface to a user (such as “wearable” circuitry, etc.).

[0032] The server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports interface interaction.

[0033] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can implement signaling interaction through the communication connection therebetween.

[0034] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.

[0035] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0036] Example Interaction

[0037] FIGS. 2A-2E illustrate example interfaces 200A-200E, in accordance with some embodiments of the present disclosure. The interfaces 200A-200E can be provided by the electronic device 110 shown in FIG. 1, for example.

[0038] In some embodiments, as shown in FIG. 2A, the electronic device 110 can present a shooting interface 200A. As an example, the electronic device 110 can provide a shooting control 206 in the shooting interface 200A. Further, the electronic device 110 can obtain media content shot by a user based on the shooting control 206. As an example, the electronic device can also provide an input control 207 in the shooting interface 200A, so as to obtain media content uploaded by the user (e.g., media content previously shot and completed by the user or stored media content) based on the input control 207. Further, the electronic device 110 can present the media content shot by the user or the media content input by the user in the creation interface 200A. As an example, the media content can include video content, graphic content, or music content, etc.

[0039] In some embodiments, in response to obtaining the media content, the electronic device 110 can present a creation interface associated with the obtained media content. For example, after completing shooting via the shooting control 206, the electronic device 110 can present an editing interface (i.e., a creation interface) of the shot media content. As another example, after completing uploading of the media content via the input control 207, the electronic device 110 can present an editing interface (i.e., a creation interface) for the uploaded media content.

[0040] In some embodiments, the electronic device 110 can also provide the creation interface without obtaining the media content, for example. As an example, the electronic device 110 can receive a trigger of the music control 205 in the shooting interface as shown in FIG. 2A, and accordingly display the creation interface.

[0041] FIG. 2B illustrates a creation interface 200B, in accordance with some embodiments of the present disclosure. Such a creation interface 200B can be triggered to be displayed in response to a selection of the music control 205 in the editing interface after obtaining the media content, or the creation interface 200B can also be triggered to be displayed in response to a selection of the music control 200 in the shooting interface 200A without obtaining any media content.

[0042] In some embodiments, as shown in FIG. 2B, the electronic device 110 can present a music generation entry 210 in the creation interface 200B. As an example, the electronic device 110 can also present preset music content in the creation interface 200B. Further, the electronic device 110 can present a music configuration window in response to receiving a trigger of the music generation entry 210.

[0043] In some embodiments, as shown in FIG. 2C, the electronic device 110 can present a music configuration window 215 in the creation interface 200C. The electronic device 110 can obtain a music generation request in the music configuration window 215. The music generation request can indicate at least one music parameter.

[0044] In some embodiments, with continued reference to FIG. 2C, the electronic device 110 can present a plurality of candidate music parameters 220 in the music configuration window.

[0045] In some embodiments, the plurality of candidate music parameters 220 can include a plurality of preset parameter contents. As an example, the plurality of preset parameter contents can be determined by a skilled person in the art, and the disclosure does not limit the specific contents of the preset parameters.

[0046] In some embodiments, when the creation interface is associated with the media content, the music generation request can indicate at least one music parameter associated with the media content.

[0047] In some embodiments, with continued reference to FIG. 2C, the plurality of music candidate parameters can include candidate parameter contents determined based on the media content obtained from the creation interface 200C.

[0048] In some embodiments, the electronic device 110 can receive a selection of at least one music parameter from the plurality of candidate music parameters to determine the at least one music parameter indicated by the music generation request.

[0049] In some embodiments, the plurality of candidate music parameters indicate at least one attribute of the target music to be generated. As an example, the at least one attribute of the target music to be generated can include lyrics content, music style, music melody, cover image description information, or related description information, etc. It should be noted that only exemplary descriptions are given here, and any attribute content associated with the target music can be included. As an example, the plurality of candidate music parameters can be description texts. For example, the candidate music parameter includes the text “sea waves”, which can indicate that one or more of the lyrics content, music style, music melody, cover image, etc. of the target music to be generated are associated with sea waves. For example, the candidate music parameter includes the text “jazz”, which can indicate that the music style and music melody of the target music to be generated are associated with “jazz”.

[0050] In some embodiments, the process of determining the plurality of candidate music parameters based on the media content can include: a first model generates description information of the media content based on image content, text content, or audio content associated with the media content. As an example, the first model can be implemented as an analysis model with the ability to analyze media content.

[0051] As an example, the analysis model can generate description information corresponding to image content, text content, or audio content based on the image content, the text content, or the audio content of the media content. For example, when the media content contains image content of a sea wave scene, the analysis model can generate description information associated with the sea wave; or when the media content contains a text of a snow mountain, the analysis model can generate description information containing the snow mountain. For another example, when the media content contains audio content with a dialogue, the analysis model can generate description information associated with the dialogue.

[0052] In some embodiments, the process of determining the plurality of candidate music parameters based on the media content can further include: determining the plurality of candidate music parameters based on the description information.

[0053] In some embodiments, the second model can determine the plurality of candidate music parameters based on the description information. As an example, the second model can be implemented as a generative model capable of generating candidate music parameters based on the description information.

[0054] As an example, the generative model can determine the plurality of candidate music parameters based on the description information. For example, the description information includes text content associated with “sea wave”, the generative model can generate a candidate music parameter containing the “sea wave” text; or the description information includes text content associated with “jazz”, the generative model can generate a candidate music parameter containing the “jazz” text.

[0055] The present disclosure does not intend to limit the specific content and training process of the first model and the second model.

[0056] In some embodiments, continuing to refer to FIG. 2C, the electronic device 110 can provide a production control 225 in the music configuration window 215. Further, the electronic device 110 can present a production process of generating target music in response to receiving a trigger (e.g., a click operation) on the production control 225.

[0057] In some embodiments, the third model can generate the target music based on at least one music parameter indicated by the music generation request. As an example, the third model can generate, based on the at least one music parameter, partial content (e.g., lyrics content, composition, cover image, etc.) of the target music associated with the at least one music parameter, and generate the target music based on the partial content of the target music. As an example, the third model generates the target music based on the at least one music parameter. The target music can directly contain corresponding content of the at least one music parameter; or the target music can contain content associated with the at least one music parameter. As an example, the at least one music parameter includes a “sea wave” text, and the lyrics content of the target music generated by the third model may, for example, include “sea wave” or may include “summer”, “sea swallow”, or “relaxed mood” associated with sea wave, etc.

[0058] As an example, the third model can be a plurality of preset models respectively having the capability of generating lyrics content, arrangement, cover image, etc., or can be an integrated large model. As an example, the present disclosure does not intend to limit the specific content and training process of the third model.

[0059] In some embodiments, with continued reference to FIG. 2C, the music generation request can also indicate the prompt item acquired via the music configuration window 215. As an example, the electronic device 110 can also provide an input control (not shown in the figure) in the music configuration window 215. Further, the electronic device 110 can acquire the prompt item (e.g., a prompt text such as “jazz style” or the like) input by the user via natural language based on the input control.

[0060] In some embodiments, the third model can also generate the target music based on the prompt item.

[0061] FIGS. 3A to 3C illustrate example interfaces 300A to 300C according to yet other embodiments of the present disclosure. The interfaces 300A to 300C can be provided by the electronic device 110 shown in FIG. 1, for example.

[0062] In some embodiments, as shown in FIG. 3A, the electronic device 110 can present a music configuration window 305 in the creation interface 300A. The electronic device 110 can acquire a music generation request in the music configuration window 305.

[0063] In some embodiments, with continued reference to FIG. 3A, the music generation request can indicate the audio content acquired via the music configuration window 315. As an example, the electronic device 110 can provide a voice control 310 in the music configuration window 315 to acquire the music content input by the user.

[0064] In some embodiments, as shown in FIG. 3B, the electronic device 110 can invoke a recording component to acquire the voice content input by the user (e.g., record the audio content of the user humming) in response to receiving a first operation (e.g., a long-press operation) of the voice control 310 by the user in the creation interface 300B.

[0065] In some embodiments, as shown in FIG. 3C, the electronic device 110 can determine the voice content input by the user (i.e., the audio content recorded from the start of the first operation to the end) as the audio content indicated by the music generation request in response to receiving an end operation (e.g., a release operation) of the first operation of the voice control 310 by the user in the creation interface 300C.

[0066] In some embodiments, the third model can also generate the target music based on the audio content acquired via the music configuration window 305. In some embodiments, the third model can also generate the target music based on the audio content acquired via the music configuration window 305.

[0067] In some embodiments, as shown in FIG. 2D, the electronic device 110 can present a production process of generating the target music based on the music generation request (e.g., an animation effect of a preset music production) in the music configuration window 215.

[0068] In some embodiments, as shown in FIG. 2E, the electronic device 110 can present a display interface 200E of the target music in response to the production of the target music being completed. The electronic device 110 can provide a play control 230 in the display interface 200E. As an example, the electronic device 110 can play the target music with the play control 230.

[0069] In some embodiments, with continued reference to FIG. 2E, the electronic device 110 can further display a cover image 235 of the target music in the display interface 200E. As an example, the cover image 235 can be generated based on the media content. As an example, the cover image can also be generated based on at least one music parameter.

[0070] In some embodiments, with continued reference to FIG. 2E, the electronic device 110 can associate the target music to the media content associated with the creation interface. As an example, the media content associated with the creation interface can include media content associated with the creation interface before the target music is generated, or media content captured by the capture component or uploaded by the user after the target music is generated.

[0071] In some embodiments, associating the target music to the media content associated with the creation interface can include capturing the media content via the capture component associated with the creation interface. Further, the target music can be associated to the captured media content. In some embodiments, with continued reference to FIG. 2E, the electronic device 110 can set the target music as background music of the media content. As an example, the electronic device 110 can provide a use control 240 in the display interface 200E. As an example, the electronic device 110 can set the target music as background music of the media content in response to receiving a trigger (e.g., a tap operation) on the use control 240.

[0072] FIGS. 4A-4C illustrate example interfaces 400A-400C, according to yet other embodiments of the present disclosure. The interfaces 400A-400C can be provided by the electronic device 110 shown in FIG. 1, for example.

[0073] In some embodiments, as shown in FIG. 4A, the electronic device 110 can present the media content containing the target music in the editing interface 400A. As an example, the electronic device 110 can provide an indication element 405 in the editing interface 400A to indicate that the media content uses the target music as background music.

[0074] In some embodiments, the electronic device 110 can update the media content based on the target music.

[0075] In some embodiments, updating the media content based on the target music can include updating background music of the media content to the target music, and presenting corresponding lyric content based on a play progress of the target music during playing the media content with the player. As an example, updating the media content based on the target music can also include adjusting the media content based on the target music. For example, adjusting can include modifying display content, audio content, or duration of the media content, etc.

[0076] In some embodiments, the electronic device 110 can publish the target work in response to a publishing request for the target music.

[0077] In some embodiments, with continued reference to FIG. 2E, the electronic device 110 can update the media content based on the target music. As an example, the electronic device 110 can provide the generate music control 245 in the display interface 200E. Further, the electronic device 110 can publish the target work in response to receiving a trigger of the generate music control 245.

[0078] In some embodiments, as shown in FIG. 4B, the electronic device 110 can present a preview interface 400B of the target music in response to receiving a trigger of the generate music control 245. The electronic device 110 can provide a preview control 410 of the target music in the preview interface 400B of the target work to play the target music.

[0079] In some embodiments, with continued reference to FIG. 4B, the electronic device 110 can also display a cover image 425 of the target music in the preview interface 400B. As an example, the cover image 425 is generated based on the media content. As an example, the cover image can also be generated based on at least one music parameter.

[0080] In some embodiments, with continued reference to FIG. 4B, the electronic device 110 can provide a set of preset music parameters 415 in the preview interface 400B. Further, the electronic device 110 can update the target music based on a selection of a target music parameter in the set of preset music parameters. As an example, as shown in FIG. 4B, the set of preset music parameters 415 can be associated with a plurality of musical styles. Further, the electronic device 110 can adjust a theme (or referred to as a musical style, a genre, etc.) of the target music to a target musical style (e.g., folk) based on a selection of the target musical style in the set of preset music parameters 415. As an example, the set of preset music parameters 415 can also be associated with description information for lyric content, a cover image, an arrangement, etc. The description information can be a short text, for example. The electronic device 110 can update the target music based on the selected description information with the third model.

[0081] In some embodiments, as shown in FIG. 4C, the electronic device 110 can present the playback interface 400C of the target work in response to receiving the publishing request. The electronic device 110 can provide a playback container 410 of the target music in the playback interface 400C of the target work for playing the target music. As an example, the electronic device 110 can play the target music with the playback container 410, and present a cover image and lyrics content of the target music. As an example, the electronic device 110 can present the corresponding lyrics content based on a playback progress of the target music.

[0082] In some embodiments, with continued reference to FIG. 4C, the electronic device 110 can present identification information 420 in the playback interface 400C to indicate that the music content played in the playback interface 400C is the target music generated based on the media content. As an example, the identification information 420 can be “XX music” for example.

[0083] Based on the above-described interaction procedure, embodiments of the present disclosure are capable of generating music content based on at least one of the media content shot or selected by the user, the hint item input by the user and / or the humming audio content, and the preset parameter, thereby improving the quality of the generated music content. In this way, embodiments of the present disclosure are capable of providing a way for the user to generate music content, meeting the user’s demand for generating music content, and improving the quality of publishing media content and user experience.

[0084] Example procedure

[0085] FIG. 5 illustrates a flowchart of an example procedure 500 of message processing according to some embodiments of the present disclosure. The procedure 500 can be implemented at the electronic device 110. The procedure 500 is described below with reference to FIG. 1.

[0086] As shown in FIG. 5, at block 510, the electronic device 110 presents a music generation entry in a creation interface.

[0087] At block 520, the electronic device 110 presents a music configuration window in response to selection of the music generation entry.

[0088] At block 530, the electronic device 110 generates target music based on a music generation request acquired via the music configuration window.

[0089] At block 540, the electronic device 110 associates the target music to media content associated with the creation interface.

[0090] In some embodiments, the music generation request indicates at least one music parameter associated with the media content.

[0091] In some embodiments, the process 500 further includes presenting a plurality of candidate music parameters in the music configuration window, the plurality of candidate music parameters being determined based on the media content; and receiving a selection of at least one music parameter of the plurality of candidate music parameters.

[0092] In some embodiments, the plurality of candidate music parameters are determined by: generating description information of the media content based on image content, text content, or audio content associated with the media content; and determining the plurality of candidate music parameters based on the description information.

[0093] In some embodiments, the plurality of candidate music parameters indicate at least one attribute of the target music to be generated.

[0094] In some embodiments, the music generation request further indicates at least one of: audio content captured via the music configuration window; or a prompt item obtained via the music configuration window.

[0095] In some embodiments, the process 500 further includes presenting a preview interface of the target music, the preview interface including a preview control of the target music.

[0096] In some embodiments, the preview interface further displays a cover image of the target music, the cover image being generated based on the media content.

[0097] In some embodiments, the process 500 further includes displaying a set of preset music parameters in the preview interface; and updating the target music based on a selection of a target music parameter of the set of preset music parameters.

[0098] In some embodiments, associating the target music to the media content associated with the creation interface includes setting the target music as background music of the media content; or updating the media content based on the target music.

[0099] In some embodiments, the process 500 further includes publishing the target work in response to a publishing request for the target music, wherein a playback page of the target work provides a playback container of the target music.

[0100] In some embodiments, the process 500 further includes presenting the creation interface in response to a preset operation received in a shooting interface of the media content; or presenting the creation interface in response to receiving an editing request for the media content.

[0101] In some embodiments, associating the target music to the media content associated with the creation interface includes shooting the media content via a shooting component associated with the creation interface; and associating the target music to the shot media content.

[0102] Example apparatus and devices

[0103] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 6 shows a schematic structural block diagram of an example apparatus 600 for message processing, according to certain embodiments of the present disclosure. The apparatus 600 can be implemented as or included in the electronic device 110. Various modules / components in the apparatus 600 can be implemented by hardware, software, firmware, or any combination thereof.

[0104] As shown in FIG. 6, the apparatus 600 includes a presentation module 610 configured to present a music generation entry in a creation interface; a processing module 620 configured to present a music configuration window in response to a selection of the music generation entry; a generation module 630 configured to generate target music based on a music generation request acquired via the music configuration window; and an association module 640 configured to associate the target music to media content associated with the creation interface.

[0105] In some embodiments, the music generation request indicates at least one music parameter associated with the media content.

[0106] In some embodiments, the apparatus 600 further includes a determination module configured to present a plurality of candidate music parameters in the music configuration window, the plurality of candidate music parameters being determined based on the media content; and receive a selection of at least one music parameter from the plurality of candidate music parameters.

[0107] In some embodiments, the plurality of candidate music parameters are determined by: generating description information of the media content based on image content, text content, or audio content associated with the media content; and determining the plurality of candidate music parameters based on the description information.

[0108] In some embodiments, the plurality of candidate music parameters indicate at least one attribute of the target music to be generated.

[0109] In some embodiments, the music generation request further indicates at least one of: audio content captured via the music configuration window; or a prompt item acquired via the music configuration window.

[0110] In some embodiments, the apparatus 600 further includes a preview module configured to present a preview interface of the target music, the preview interface including a preview control of the target music.

[0111] In some embodiments, the preview interface further displays a cover image of the target music, the cover image being generated based on the media content.

[0112] In some embodiments, the apparatus 600 further includes a parameter module configured to display a set of preset music parameters in the preview interface; and update the target music based on a selection of a target music parameter from the set of preset music parameters.

[0113] In some embodiments, the association module 640 is further configured to: set the target music as background music of the media content; or update the media content based on the target music.

[0114] In some embodiments, the apparatus 600 further includes a publishing module configured to: in response to a publishing request for the target music, publish the target work, wherein a play page of the target work provides a play container of the target music.

[0115] In some embodiments, the apparatus 600 further includes a creation module configured to: in response to a preset operation received in a shooting interface of the media content, present a creation interface; or in response to receiving an editing request for the media content, present the creation interface.

[0116] In some embodiments, the association module 640 is further configured to: shoot the media content via a shooting component associated with the creation interface; and associate the target music to the shot media content.

[0117] FIG. 7 illustrates a block diagram of an electronic device 700 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 700 illustrated in FIG. 7 is merely exemplary and should not be construed as any limitation to the functionality and scope of the embodiments described herein. The electronic device 700 illustrated in FIG. 7 can be used to implement the electronic device 110 of FIG. 1.

[0118] As shown in FIG. 7, the electronic device 700 is in the form of a general electronic device. The components of the electronic device 700 can include, but are not limited to, one or more processing units or processors 710, a memory 720, a storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processor 710 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 720. In a multi-processor system, multiple processors perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 700.

[0119] The electronic device 700 typically includes a plurality of computer storage media. Such media can be volatile and / or nonvolatile, removable and / or non-removable, and can be implemented in any method or technology for storage of information and / or data. The memory 720 can be volatile (such as random access memory (RAM)), non-volatile (such as read-only memory (ROM), flash memory, or any other memory technology), or some combination of the multiple memory types. The storage device 730 can be a removable storage medium or a non-removable storage medium implemented in any method or technology for storage of information and / or data.

[0120] The electronic device 700 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 7, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile computer-readable medium. In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 720 can include a computer program product 725 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0121] The communication unit 740 enables communications with other electronic devices over a communication medium. Additionally, the functionality of the components of the electronic device 700 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating with one another over a communication connection. As such, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.

[0122] The input device 750 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 760 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 700 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 740, as needed, one or more devices that enable a user to interact with the electronic device 700, or any device (e.g., a network card, a modem, etc.) that enables the electronic device 700 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0123] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0124] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0125] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium. The instructions stored on the computer readable storage medium can be used to program a computer, a programmable data processing apparatus, and / or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0126] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0127] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk drive, or any other suitable non-transitory computer readable medium can store the computer program product.

[0128] Having described several implementations of the present disclosure, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The implementation described herein is implementations of the present disclosure. Other implementations of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the present disclosure. Therefore, this disclosure is intended to cover all such modifications and variations as fall within the scope of the implementations. It is intended that the specification and depicted embodiments are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A media editing method, comprising: presenting a music generation entry in an authoring interface; in response to a selection of the music generation entry, presenting a music configuration window; generating target music based on a music generation request acquired via the music configuration window; and associating the target music to media content associated with the authoring interface. 2.The method of claim 1, wherein the music generation request indicates at least one music parameter associated with the media content. 3.The method of claim 2, further comprising: presenting a plurality of candidate music parameters in the music configuration window, the plurality of candidate music parameters being determined based on the media content; and receiving a selection of the at least one music parameter from the plurality of candidate music parameters. 4.The method of claim 3, wherein the plurality of candidate music parameters are determined by: generating description information of the media content based on image content, text content or audio content associated with the media content; and determining the plurality of candidate music parameters based on the description information. 5.The method of claim 3, wherein the plurality of candidate music parameters indicate at least one attribute of the target music to be generated. 6.The method of claim 1, wherein the music generation request further indicates at least one of: audio content captured via the music configuration window; or a prompt acquired via the music configuration window. 7.The method of claim 1, further comprising: presenting a preview interface of the target music, the preview interface comprising a preview control of the target music. 8.The method of claim 7, wherein the preview interface further displays a cover image of the target music, the cover image being generated based on the media content. 9.The method of claim 7, further comprising: displaying a set of preset music parameters in the preview interface; and updating the target music based on a selection of a target music parameter from the set of preset music parameters. 10.The method of claim 1, wherein associating the target music to media content associated with the authoring interface comprises: setting the target music as background music of the media content; or updating the media content based on the target music. 11.The method of claim 1, further comprising: in response to a publishing request for the target music, publishing a target work, wherein a playback page of the target work provides a playback container of the target music. 12.The method of claim 1, further comprising: in response to a preset operation received in a shooting interface of the media content, presenting the authoring interface; or in response to receiving an editing request for the media content, presenting the authoring interface. 13.The method of claim 1, wherein associating the target music to media content associated with the authoring interface comprises: shooting the media content via a shooting component associated with the authoring interface; and associating the target music to the shot media content. ​ ​ ​ ​ ​ ​ 14. An apparatus for media editing, comprising: a presentation module configured to present a music generation entry in an authoring interface; a processing module configured to present a music configuration window in response to a selection of the music generation entry; a generation module configured to generate target music based on a music generation request acquired via the music configuration window; and an association module configured to associate the target music to media content associated with the authoring interface.

15. An electronic device, comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1-13.

16. A computer-readable storage medium having computer-executable instructions stored thereon that are executable by a processor to implement the method according to any one of claims 1-13.

17. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1-13. ​

Citation Information

Patent Citations

  • Music generation method and device, electronic equipment and storage medium

    CN116403549A

  • Music editing method and device, electronic equipment and computer readable storage medium

    CN116935817A

  • Music generation method, device and system and storage medium

    CN117012170A

  • System and method for automatically generating musical output

    US20180268792A1