Music generation method, music generation device and computer readable storage medium

By displaying the guide information of music generation on the interactive interface between the user and the agent and allowing the user to adjust the description information, the problem of poor music generation in the prior art is solved, high-quality and personalized music generation is achieved, and the User experience.

CN119072740APending Publication Date: 2024-12-03BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202480002225.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-04-24
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing music generation technology is limited by the performance of machine learning models and the accuracy of user's description of music text, resulting in the automatic generated music being unable to meet the needs of users and cannot achieve high-quality music generation.

Method used

By displaying the guide information generated by music on the interactive interface between the user and the agent, the user is allowed to input and adjust the description information of the music, the initial music works are generated using the machine learning model, and the music is regenerated according to the user's adjustments, and targeted music is achieved optimization.

Benefits of technology

It improves the quality and user experience of music generation, meets users' personalized needs for music, and improves the accuracy and satisfaction of music generation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119072740A_ABST
    Figure CN119072740A_ABST
Patent Text Reader

Abstract

The invention relates to a music generation method, a music generation device and a computer readable medium, and relates to the technical field of computers. The music generation method comprises the following steps: receiving first prompt information input by a user, wherein the first prompt information comprises description information of music; according to the first prompt information, generating a first music work, the first music work including first music; a second music work is generated according to the adjustment operation of the user for the first music work, and the adjustment operation comprises at least one of the adjustment operation for the first prompt information and the adjustment operation for the first music.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a music generating method, a music generating device, a computer-readable storage medium, and a computer program product. Background Art

[0002] Music generation technology is an important application in the field of computer technology. With the rapid development of artificial intelligence technology, natural language processing technology is widely used in music generation, using machine learning models to automatically generate music data based on text data.

[0003] However, due to the limitations of the performance of machine learning models and the accuracy of users' textual descriptions of music, automatically generated music often fails to meet user needs. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure propose a music generation method, a music generation device, a computer-readable storage medium, and a computer program product. After automatically generating music according to a text description, the user can make targeted adjustments to the generated music according to the guidance of the intelligent agent, and regenerate the music according to the user's adjustments, thereby improving the quality of music generation and enhancing the user experience.

[0005] According to a first aspect of some embodiments of the present disclosure, a music generation method is provided, comprising: on an interaction interface between a user and an intelligent agent, in response to a music generation request of the user, displaying guidance information for music generation; in response to first prompt information input by the user based on the guidance information, outputting a first music work generated according to the first prompt information, the first prompt information including description information of the music, and the first music work including first music; in response to an adjustment made by the user to the first music work, outputting a second music work generated according to the adjustment, the adjustment including at least one of an adjustment to the first prompt information and an adjustment to the first music.

[0006] According to a second aspect of some embodiments of the present disclosure, there is provided a music generating device, comprising: a display module, configured to display, on an interaction interface between a user and an intelligent agent, guidance information for music generation in response to a music generation request of the user; a first output module, configured to output, in response to first prompt information input by the user based on the guidance information, a first music work generated according to the first prompt information, the first prompt information comprising descriptive information of the music, and the first music work comprising first music; a second output module, configured to output, in response to an adjustment made by the user to the first music work, a second music work generated according to the adjustment, the adjustment comprising at least one of an adjustment to the first prompt information and an adjustment to the first music.

[0007] According to a third aspect of some embodiments of the present disclosure, there is provided a music generating device, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute any one of the aforementioned music generating methods based on instructions stored in the memory.

[0008] According to a fourth aspect of some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, any one of the aforementioned music generation methods is implemented.

[0009] According to a fifth aspect of some embodiments of the present disclosure, a computer program product is provided, which, when executed on a computer, enables the computer to implement any one of the aforementioned music generation methods.

[0010] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0011] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:

[0013] Figure 1 A flowchart showing a music generation method according to some embodiments of the present disclosure;

[0014] Figure 2A An interactive interface for music generation according to some embodiments of the present disclosure is shown;

[0015] Figure 2B An interactive interface for music generation according to other embodiments of the present disclosure is shown;

[0016] Figure 2C An interactive interface for music generation according to some other embodiments of the present disclosure is shown;

[0017] Figure 3A An interactive interface after generating the first music according to some embodiments of the present disclosure is shown;

[0018] Figure 3BShowing an interactive interface after generating the first music according to some other embodiments of the present disclosure;

[0019] Figure 3C An interactive interface after generating the first music according to some other embodiments of the present disclosure is shown;

[0020] Figure 4A An interactive interface for adjusting a musical work according to some embodiments of the present disclosure is shown;

[0021] Figure 4B An interactive interface for adjusting a musical work according to other embodiments of the present disclosure is shown;

[0022] Figure 4C An interactive interface for adjusting a musical work according to yet other embodiments of the present disclosure is shown;

[0023] Figure 4D An interactive interface for adjusting a musical work according to some further embodiments of the present disclosure is shown;

[0024] Figure 5A A flowchart showing generation of a second musical composition according to some embodiments of the present disclosure;

[0025] Figure 5B A flowchart showing generation of a second musical work according to some other embodiments of the present disclosure;

[0026] Fig. 6A A flowchart showing generation of a second musical composition based on an editing control according to some embodiments of the present disclosure is shown;

[0027] Figure 6B A flowchart showing generation of a second musical work based on an editing control according to other embodiments of the present disclosure is shown;

[0028] Fig. 7A An editing interface of a music work according to some embodiments of the present disclosure is shown;

[0029] Figure 7B Showing an editing interface of a music work according to some other embodiments of the present disclosure;

[0030] Figure 8 A flowchart showing a music generation method according to some other embodiments of the present disclosure;

[0031] Fig. 9 A block diagram showing a music generating device according to some embodiments of the present disclosure;

[0032] Fig.10 A block diagram showing a music generating device according to some other embodiments of the present disclosure;

[0033] Fig.11 A block diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0034] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.

[0036] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.

[0037] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".

[0038] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.

[0039] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.

[0040] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0041] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0042] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.

[0043] In related music generation technologies, the automatically generated music often cannot meet the needs of users due to the performance of machine learning models and the accuracy of users' text descriptions of music. In order to improve the quality of music generation and enhance user experience, the disclosed embodiments provide a new music generation method. After music is automatically generated based on text descriptions, users can make targeted adjustments to the generated music based on the guidance of the intelligent agent, and regenerate music based on the user's adjustments.

[0044] Figure 1 A flowchart of a music generation method according to some embodiments of the present disclosure is shown.

[0045] like Figure 1As shown, the music generation method includes: step S1, on the interaction interface between the user and the intelligent agent, in response to the music generation request of the user, displaying the guidance information of music generation; step S2, in response to the first prompt information input by the user based on the guidance information, outputting the first music work generated according to the first prompt information, the first prompt information includes the description information of the music, and the first music work includes the first music; step S3, in response to the user's adjustment to the first music work, outputting the second music work generated according to the adjustment, the adjustment includes at least one of the adjustment to the first prompt information and the adjustment to the first music.

[0046] The music generation method of this embodiment can be executed on the client side, or partially on the server side.

[0047] The first musical work may be a pure music work without lyrics, and only includes the first music, such as a piano piece, a guitar piece, or other pure music. The first musical work may also be a vocal music work, which includes not only the first music but also the human voice corresponding to the first music. Usually, a vocal music work also includes lyrics, and the human voice sings the content of the lyrics.

[0048] Reference below Figure 2A-2C , further describing the music generation method according to the embodiment of the present disclosure. Figure 2A-2C The interactive interfaces for music generation according to different embodiments of the present disclosure are respectively shown.

[0049] like Figure 2A As shown in FIG. 1 , an input box is provided in the interactive interface for music generation. In response to the music generation instruction input by the user in the input box through text or voice, the guidance information for music generation is displayed on the interactive interface between the user and the agent. In addition to calling the music generation model by inputting the music generation instruction, the music generation model can also be called by triggering the music generation instruction. Figure 2A The music generation control shown at the bottom of the interactive interface is used to send the user's music generation request.

[0050] The guidance information generated by music is, for example, Figure 2AThe message “Please tell me what kind of music you want to create? You can try to describe the picture in front of you and your mood, such as the California sunset, coconut trees, agility, humid rainy season, love and loss” guides the user to enter the description information of the music. The user can enter the description information of the music according to the guidance information. The description information of the music may include at least one of the theme of the music, the picture of the music, the emotional type of the music, and the style type of the music. The themes of the music include, for example, missing home, missing friends, celebrating success, etc. The pictures of the music include, for example, sunsets, waves, reefs, streets, buildings, etc. The emotional types of the music include, for example, sadness, joy, helplessness, touching, tranquility, etc. The style types of the music include, for example, rock, jazz, pop, folk, rap, etc.

[0051] like Figure 2A As shown, the user inputs the description information of the music through text or voice, "In the afterglow of the sunset, the waves beat against the rocks, and the fishing boats sing softly in the distance, tranquility", which describes the picture of the music and the emotional type of the music.

[0052] Of course, in order to help users input more accurate prompt information more efficiently, some suggestions can be provided on the interactive interface to facilitate users to make choices.

[0053] Figure 2B Another interactive interface for music generation is shown. Figure 2B Guidance information for music generation is also displayed to guide the user to input descriptive information of the music.

[0054] like Figure 2B As shown, the guide information includes at least one candidate prompt template, each candidate prompt template corresponds to a complete music scene, and the information of each candidate prompt template includes at least one of the theme of music, the picture of music, the emotional type of music, and the style type of music. The prompt information in a candidate prompt template selected by the user is used as part or all of the first prompt information.

[0055] like Figure 2B As shown, multiple candidate prompt templates are displayed in the interactive interface for the user to choose. For example, the information of a candidate prompt template may include "In the afterglow of the sunset, the waves beat against the reefs, and the gentle singing of fishing boats can be heard in the distance, which is tranquil", reflecting the picture of the music and the emotional type of the music. For another example, the information of another candidate prompt template may include Li Bai's "Drinking Song", which reflects the theme of the music and the style of the music.

[0056] Since each candidate prompt template corresponds to a complete music scene, the user can only select one candidate prompt template. The prompt information in a candidate prompt template selected by the user can be directly applied to the input box as the first prompt information. Figure 2AAs shown, if the user selects the candidate prompt template "In the afterglow of the setting sun, the waves beat against the rocks, and the gentle singing of fishing boats can be heard in the distance, tranquility", the corresponding prompt information is directly applied to the input box.

[0057] Of course, the user can further adjust the prompt information based on the prompt information of the candidate prompt template, for example, delete, add, etc. the prompt information in the input box. In this case, the prompt information in a candidate prompt template selected by the user is only a part of the first prompt information.

[0058] In other embodiments, Figure 2C As shown, the guide information includes at least one candidate prompt information, and each candidate prompt information includes at least one of the theme of music, the picture of music, the emotional type of music, and the style type of music; the one or more candidate prompt information selected by the user serves as part or all of the first prompt information.

[0059] like Figure 2C As shown, multiple candidate prompt information is displayed in the interactive interface for the user to select. For example, the candidate prompt information may include prompt information reflecting the theme, picture, emotion type, and style type of music, such as missing, sunset, waves, reefs, fishing boats, cheerful, tranquil, rock, folk songs, etc.

[0060] The user can select multiple candidate prompt information and combine them. The candidate prompt information selected by the user can be directly applied to the input box as the first prompt information. Figure 2C As shown, the user can select multiple candidate prompt information "sunset", "waves", "reefs", "fishing boats", "tranquility". Of course, the user can also further adjust the prompt information in the input box, for example, using, to modify the above selected prompt information combination "sunset, waves, reefs, fishing boats, tranquility" to "in the sunset, waves beat against the reefs, the fishing boats sing softly in the distance, tranquility". For example, in this case, the multiple candidate prompt information selected by the user is only a part of the first prompt information.

[0061] Combined with the above Figure 2A-2C The following describes how to display the guidance information of music generation in response to the user's music generation request in step S1, and how to receive the first prompt information input by the user. Figures 3A-4D Next, it is described how to output the first music piece according to the first prompt information in step S2 and how to output the second music piece according to the user's adjustment to the first music piece in step S3.

[0062] In step S2, the first music piece may be generated according to the first prompt information using a machine learning model. The first music piece also includes a title and a cover of the first music piece. Similarly to generating the first music piece, the title and the cover of the first music piece may be generated according to the first prompt information using a machine learning model. Figure 2B , 2C As shown, the S-style painting control at the bottom of the interactive interface can also be triggered to generate a cover of the corresponding style painting. The S-style painting control can be configured based on user behavior or hot screens.

[0063] Machine learning models include, for example, large language models (LLM) or other natural language processing (NLP) models. For example, machine learning models such as variational autoencoders (VAE), generative adversarial networks (GAN), and transformers can be used to achieve diversified and high-quality music generation. Figure 3A An interactive interface after generating the first music according to some embodiments of the present disclosure is shown.

[0064] exist Figure 3A On the interactive interface shown, the generated first music piece is output, including playing the first music, and displaying the title and cover of the first music. For example, the title of the music is displayed as "Sunset and Waves", and the cover of the music can be displayed as a picture of the sunset on the sea.

[0065] Figure 3A Guidance information for guiding the user to adjust the generated music piece is also shown, such as "The following is the music generated for you, you can try to provide a richer description to obtain new music." The user can regenerate music by changing the prompt information.

[0066] For example, the user can select Figure 3A The prompt suggestion given on the interactive interface shown triggers the regenerated control to regenerate the music based on the new prompt information. Of course, the user can also directly enter new prompt information or modify the first prompt information in the input box.

[0067] Figure 3B The interactive interface after generating the first music according to some other embodiments of the present disclosure is shown. Figure 3B As shown in FIG. 1 , the user adds a prompt information describing the style of music, such as “pop music”, based on the first prompt information “In the afterglow of the sunset, the waves beat against the rocks, and the gentle singing of fishing boats can be heard in the distance, tranquility”. That is, the user adds a prompt information describing the style of music, such as “pop music”. Figure 3B Enter the command "Music generation: in the afterglow of the sunset, the waves beat against the rocks, and in the distance comes the gentle singing of fishing boats, quiet, pop music" on the interactive interface shown to regenerate the music. Figure 3B Some recommended tips are also displayed for users to choose from.

[0068] Figure 3C The interactive interface after generating the first music according to some other embodiments of the present disclosure is shown. Figure 3A , 3B Similar, in Figure 3C The generated first music piece is also output on the interactive interface shown, including playing the first music and displaying the title and cover of the first music. Figure 3A , 3B The difference is, Figure 3C Some recommended adjustment information is also shown, including adjusting basic attributes and / or style type of the music, or adding lyrics.

[0069] like Figure 3C As shown in FIG. 1 , on the interactive interface with the agent, recommended adjustment information such as “faster tempo”, “change song style”, and “add lyrics” are displayed. These recommended adjustment information can be configured as controls in the form of labels. The user's selection operation of these controls is equivalent to inputting the corresponding recommended adjustment information.

[0070] In some embodiments, in response to the adjustment of the first musical work input by the user, outputting the second musical work generated according to the adjustment includes: receiving the user's adjustment information for basic attributes and / or style type of the first music, the basic attributes including the rhythm, melody, timbre, and harmony of the music; outputting the second musical work generated according to the adjustment information, the second musical work including second music.

[0071] Figure 4A The interactive interface for adjusting a music work according to some embodiments of the present disclosure is shown. Figure 3C The user selects the recommended adjustment information of "faster rhythm" on the interactive interface shown in the figure to adjust the rhythm of the first music piece to obtain the second music piece. Next, the user returns to the second music piece after the rhythm is adjusted on the interactive interface between the user and the agent, as shown in the figure. Figure 4A The second musical work also includes the title and cover of the second music, which may be the same as or different from the title and cover of the first music.

[0072] Figure 4AFurther guidance information is also displayed, such as "The following is the music with the rhythm adjusted for you. If you feel that the rhythm is not fast enough, you can continue to modify it through the following tags." For example, the user can continue to select the recommended adjustment information of "faster rhythm" to further adjust the rhythm of the music.

[0073] Figure 4B The interactive interface for adjusting music works according to other embodiments of the present disclosure is shown. Figure 3C Select the recommended adjustment information of "Change Song Style" on the interactive interface shown to adjust the song style of the first music. Next, further guidance information can be returned on the interactive interface between the user and the agent, such as Figure 4B "OK! Please describe the style of song you want to hear or select it below."

[0074] Figure 4B Some recommended song styles are shown, such as pop, dance, rap, rock, folk, ancient style, ballad, electronic, jazz, etc., for users to choose.

[0075] For example, a user Figure 4B Select a recommended song style, such as folk song, on the interactive interface shown in FIG. 3 to adjust the song style from pop music to folk song to obtain the second music. Next, the second music piece with adjusted rhythm is returned on the interactive interface between the user and the agent, such as Figure 4B shown.

[0076] Of course, when the first music generated is pure music, adjustments such as adding lyrics and vocals can also be made first.

[0077] In some embodiments, in response to the adjustment input by the user to the first musical work, outputting the second musical work generated according to the adjustment includes: receiving the adjustment information of the user adding lyrics to the first music; and outputting the first lyrics generated according to the first prompt information and the first music as part of the second musical work.

[0078] Combine the following Figure 4C and Figure 5A It further describes how to adjust a musical work according to adjustment information of lyrics added by a user to the music.

[0079] Figure 4C The interactive interface for adjusting music works according to some other embodiments of the present disclosure is shown. Figure 4C As shown, in response to receiving a user input instruction to add lyrics, the first lyrics corresponding to the first music are output. In some embodiments, a machine learning model is used to generate the first lyrics based on the first prompt information and the first music.

[0080] like Figure 4C As shown, after the first lyrics are generated, a guide message is displayed to guide the user to modify the lyrics, such as "OK! The lyrics have been generated according to your description, you can modify them." The generated lyrics content is displayed in the text box at the bottom of the interactive interface, and the user can modify them based on this.

[0081] Figure 5A A flow chart of generating a second musical work according to some embodiments of the present disclosure is shown. Figure 5A As shown, in response to the adjustment input by the user for the first musical work, outputting the second musical work generated according to the adjustment includes: step S31A, receiving the adjustment information of the user for adding lyrics to the first music; step S32A, outputting the first lyrics generated according to the first prompt information and the first music; step S33A, receiving the adjustment information of the user for the first lyrics; step S34A, displaying the second lyrics obtained based on the adjustment information as part of the second musical work.

[0082] Adjustments to the first lyrics can also be made with the help of machine learning models, for example Figure 4C The AI-assisted control is displayed at the bottom of the text box. In response to the user triggering the AI-assisted control, a second lyric that matches the music can be generated based on the first lyric and the user's input using a machine learning model. That is, the first music, the first lyric, and the user's input are comprehensively considered, and a machine learning model is used to generate new lyrics so that the generated lyrics better match the music. For vocal music, there must also be a corresponding human voice, that is, the singer's voice. The following is combined with Figure 4D and Figure 5B Further describing how to adjust the music work according to the user's adjustment information for adding vocals to the music.

[0083] Figure 5B A flowchart of generating a second musical work according to some other embodiments of the present disclosure is shown. Figure 5B As shown, in response to the adjustment input by the user for the first musical work, outputting the second musical work generated according to the adjustment includes: step S31B, receiving the user's adjustment information for adding vocals to the first music; step S32B, providing the timbre of multiple singers according to the adjustment information; step S33B, outputting the vocals generated according to the timbre of one or more singers selected by the user as part of the second musical work.

[0084] Figure 4D The interactive interface for adjusting music works according to some other embodiments of the present disclosure is shown. Figure 4C Add lyrics, such as Figure 4DAs shown, in response to receiving the instruction of adding human voice input by the user, further guidance information can be returned on the interaction interface between the user and the intelligent agent, such as Figure 4D "OK! Describe the vocal you want to me, or select it below."

[0085] Users can use a default voice that matches the music and its lyrics. The default voice can be based on the user's past selections. Of course, users can also choose other voices according to actual needs. For example, users can choose their own voice or choose the voice of other singers according to their preferences.

[0086] In the case where the user uses his own voice, the voice of the singer can be generated according to the user's voice using voice imitation technology. Of course, if the client or server has stored the user's voice, it can also be directly called based on the user's authorization.

[0087] When the user uses other vocals, the machine learning model is used to generate the singer's voice based on the first music and the first lyrics. Of course, when the vocal music does not include lyrics, the singer's voice can also be generated based only on the first music. There can be multiple singers' voices generated using the machine learning model.

[0088] like Figure 4D As shown, in the interactive interface for adjusting the music work, a variety of sounds are displayed for users to choose from. Figure 4D The voice of A shown is, for example, the voice of a poet, the voice of B is, for example, the voice of an actor, the voice of C is, for example, the voice of a character in a movie or TV series, and the default voice is, for example, the voice of a singer.

[0089] like Figure 4D As shown, the user can select the singer's voice according to actual needs, or input the description information of the human voice to obtain the corresponding human voice.

[0090] Combination of the above Figures 3A-3C , Figures 4A-4D It describes how to output the second music piece according to the user's prompt information, basic attributes, style type, lyrics, and vocal adjustment information for the first music piece. In addition to adjusting the generated music piece through interactive information with the intelligent agent, the user can also directly enter the editing interface of the music piece.

[0091] exist Figures 3A-3C , Figures 4A-4D In addition to displaying the generated music works, the interface also includes controls for editing, publishing or sharing. Figure 3C and Figure 6A-6B , Figure 7A-7BThe following describes how to output the second musical composition according to the user's adjustment to the first musical composition.

[0092] Fig. 6A A flowchart of generating a second musical composition based on editing controls according to some embodiments of the present disclosure is shown.

[0093] like Fig. 6A As shown, in response to the adjustment input by the user for the first musical work, outputting the second musical work generated according to the adjustment includes: step S31, displaying the editing control of the first musical work; step S32, in response to the user triggering the editing control, entering the editing interface for the first musical work; step S33, generating the second musical work according to the user's adjustment operation on the first musical work in the editing interface, the adjustment operation including at least one of the adjustment operation on the first prompt information and the adjustment operation on the first music.

[0094] Figure 3C In response to the user's Figure 3C The editing controls in the editor are triggered to enter the independent music creation interface, such as Fig. 7A shown.

[0095] Fig. 7A The editing interface of a music work according to some embodiments of the present disclosure is shown, which supports fine adjustment of the music work. Fig. 7A As shown, the prompt information previously inputted is displayed in the input box of the prompt information for generating music, that is, the first prompt information for generating the first music. The user can modify the first prompt information based on this.

[0096] Figure 6B A flowchart of generating a second musical work based on an editing control according to some other embodiments of the present disclosure is shown. Figure 6B As shown, generating the second music work according to the user's adjustment operation on the first music work in the editing interface includes: step S331, receiving the user's modification operation on the first prompt information; step S332, displaying the second prompt information obtained based on the modification operation; step S333, using the machine learning model to generate the second music work according to the second prompt information.

[0097] In addition to displaying the first prompt information previously used to generate the first music, further prompt information can be recommended based on the generated first music, that is, some suggestions are given to help the user adjust the first music work. Fig. 7AThe editing interface shown displays at least one recommendation prompt information based on the first musical work, and the recommendation prompt information includes at least one of the theme of the music, the picture of the music, the emotional type of the music, and the style type of the music.

[0098] Fig. 7A Some recommended information is displayed, such as pop, ancient style, folk songs, etc. related to the style of music. Fig. 7A It also displays recommended prompt information related to the theme of the music, such as missing, nostalgia, etc., as well as prompt information related to the picture of the music, such as a fisherman.

[0099] For example, after the first music has been generated based on the first prompt information such as "In the afterglow of the sunset, the waves hit the reefs, and the fishing boats sing softly in the distance, tranquility", some prompt information can be recommended based on the picture in the first music "In the afterglow of the sunset, the waves hit the reefs, and the fishing boats sing softly in the distance", the emotional type of the music "tranquility", etc., such as Fig. 7A The prompt information about the theme is shown as "Missing", "Nostalgia", the prompt information about the style type is "Popular", "Folk Song", "Ancient Style", the prompt information about the picture is "Fisherman", etc. The user can select one or more recommended prompt information, and the one or more recommended prompt information selected by the user can be used as part of the second prompt information.

[0100] In step S31 and step S32, the user can modify the first prompt information to obtain the second prompt information. For example, the first prompt information includes that the style type of the music is popular, and the user can modify it to folk song to obtain the second prompt information. For another example, the first prompt information includes that the emotional type of the music is sad, and the user can modify it to helpless to obtain the second prompt information. Similarly, the user can modify the theme, picture, etc. of the music in the first prompt information to obtain the second prompt information.

[0101] Of course, the user can also delete part of the descriptive information of the music from the first prompt information, or add the descriptive information of the music to the first prompt information to obtain the second prompt information. For example, the first prompt information includes the theme of the music as celebrating success, the picture of the music as architecture, and the emotion of the music as cheerfulness. The user can delete the descriptive information of the picture of the music, and the obtained second prompt information includes less descriptive information of the music, reducing the restrictions on the picture of the generated music. Of course, in this case, the user can also add descriptive information for the style type of the music, for example, if the style type of the music is popular, the obtained second prompt information includes more descriptive information of the music, improving the matching degree between the generated music and the user's needs.

[0102] In step S33, a machine learning model is used to generate a second musical work that better meets the user's needs based on the second prompt information obtained by adjusting the first prompt information.

[0103] It should be understood that the user's adjustment operation on the first music piece may be an adjustment operation on the first prompt information, an adjustment operation on the first music, or both. The adjustment operation on the first music may include adjustment of basic attributes of the music.

[0104] In some embodiments, generating the second musical work according to the user's adjustment operation on the first musical work includes: generating the second musical work according to the user's adjustment operation on basic attributes of the first music, the basic attributes including rhythm, melody, timbre, and harmony of the music.

[0105] If the user is not satisfied with the rhythm of the generated first music, the rhythm of the first music can be adjusted separately. The rhythm of music generally includes the beat, speed, accent and style of the music. The user can adjust at least one of the beat, speed, accent and style of the first music to adjust the rhythm of the first music.

[0106] Figure 7B An editing interface for a music work according to some other embodiments of the present disclosure is shown. Figure 7B The editing interface shown in FIG. 1 shows the speed control. In response to the user triggering the speed control, the speed editing interface pops up. Figure 7B As shown, the user can move the speed adjustment control to adjust the speed of the music.

[0107] Similarly, the user can also adjust the melody, timbre, harmony, etc. of the first music based on his or her understanding and preference of music to obtain a second music work that better meets his or her needs.

[0108] The adjustment operation on the basic attribute of the first music can be performed on the first music as a whole. Since the music can be divided into sections, the first music can also be adjusted in sections.

[0109] For example, the first music includes multiple paragraphs. In response to the user's input adjustment to the first music work, outputting the second music work generated according to the adjustment includes: generating the second music work according to the user's adjustment operation on the basic attributes of at least one paragraph among the multiple paragraphs of the first music, and the basic attributes include the rhythm, melody, timbre, and harmony of the music.

[0110] Only the basic properties of a part of the first music passages may be adjusted, for example, only the rhythm of the music passage corresponding to the prelude of the first music passage may be adjusted without adjusting other parts of the first music passages.

[0111] The rhythm adjustment of the first music can be further refined. For example, each section of the music has multiple beats, and the user is supported to adjust the rhythm of the first music by beats, which can more efficiently generate music works that match user needs.

[0112] For example, each of multiple paragraphs of a first piece of music includes multiple beats, the rhythm of the first piece of music includes the beats of the music, and in response to the adjustment of the first piece of music input by the user, outputting a second piece of music generated according to the adjustment includes: displaying the audio track of the first music; generating the second piece of music according to the user's adjustment operation on the first music based on the audio track, and the adjustment operation on the first music includes adjusting at least one of the duration of the beat and adjusting the combination rules between the beats.

[0113] A track may correspond to a part of music. Each track may correspond to the performance of a musical instrument. The first music may include multiple tracks, and the display of the tracks of the first music may support user adjustments based on the tracks, that is, the second music work may be generated based on the user's adjustment operation on at least one of the multiple tracks of the first music.

[0114] For example, among the multiple tracks of the first music, the first track corresponds to the performance of the drums, so that the whole music has a rhythmic backbone, the second track corresponds to the rhythm of the bass, coordinated with the performance of the drums, the third track corresponds to the performance of the guitar in accordance with the beat, and the fourth track corresponds to the singing of the human voice in accordance with the music. The user can adjust not all tracks, but only some tracks. The user can adjust only the performance of the guitar in the third track. Specifically, the duration of each beat in the third track (i.e., the note time value) can be adjusted, and the combination rule of the strong beat and the weak beat in the third track can also be adjusted. Of course, both can be adjusted.

[0115] It has been described in detail above in combination with different embodiments that the user's adjustment to the first musical work includes both overall adjustment, such as adjustment to the first prompt information used to generate the musical work, and local adjustment, such as adjustment to basic attributes such as the rhythm and melody of the generated music. In addition, the musical work includes music and lyrics. Since there is a certain degree of independence between the music and the lyrics in the musical work, the music and the lyrics can be adjusted separately to efficiently generate a musical work that better meets the user's needs.

[0116] Combined with the above Figure 1-7B A number of embodiments of the music generation method are described in detail. Figure 8 A specific application example of the music generation method is described. FIG7 shows a flowchart of the music generation method according to some other embodiments of the present disclosure.

[0117] like Figure 8 As shown, taking a music work with vocals as an example, the music generation method includes: step S1', on the interaction interface between the user and the intelligent agent, in response to the music generation request of the user, displaying the guidance information of music generation; step S2', according to the first prompt information input by the user, outputting the first music work, the first music work includes the first music and its title and cover; step S3', according to the user's adjustment to the first music work, outputting the second music work, the second music work includes the second music and its title and cover, lyrics, and vocals.

[0118] In step S1' and Figure 1 At least one prompt information suggestion may be provided in the interactive interface for the user to select as part or all of the first prompt information.

[0119] The prompt information suggestion can be a candidate prompt template, such as Figure 2B As shown, the user can only choose one. For example, the user can select the candidate prompt template "In the afterglow of the sunset, the waves beat against the reefs, and the fishing boats sing softly in the distance, tranquility", and the prompt information included in the prompt template can be directly applied to the input box of the prompt information. The user can directly use these prompt information as the first prompt information for generating the first music. Of course, the user can also adjust the prompt information on this basis, such as adding the descriptive information "popular" about the style type of music, to obtain the first prompt information with more music description information.

[0120] Hint suggestions can also be candidate hints, such as Figure 2C As shown, the user can select multiple candidate prompt information and combine them. For example, the user can select multiple candidate prompt information "sunset afterglow", "waves", "reefs", "fishing boats", "tranquility". Similarly, these prompt information can be directly applied to the input box of the prompt information. The user can directly use these prompt information as the first prompt information for generating the first music. Of course, the user can also adjust the prompt information on this basis, such as adding descriptive information "fisherman" about the picture of the music, to obtain the first prompt information with more music description information.

[0121] Next, in step S2', the first music is generated according to the first prompt information using the machine learning model. Considering the display requirements of the music work, the title and cover corresponding to the first music can also be generated according to the first prompt information using the machine learning model. Of course, it is also possible to generate a title and cover corresponding to the first music according to the first prompt information. Figure 2B Or the control described in 2C about the music picture generates the cover of the music. Then, the first music and its title and cover are synthesized into the first music work.

[0122] Next, in step S3', a second musical composition is generated based on the user's adjustments to the first musical composition using a machine learning model.

[0123] The adjustment to the first musical work may be an adjustment to the first prompt information used to generate the first music, an adjustment to the basic attributes of the first music, an adjustment to add lyrics or vocals to the first music, or an adjustment to the title or cover of the music.

[0124] The adjustment of the first music work may be performed based on the adjustment information input by the user, or based on the adjustment operation of the user on the editing interface of the music work.

[0125] Regarding the adjustment of the prompt information, the previously entered prompt information can be displayed in the input box, so that the user can edit the prompt information based on this. Figure 3B The interactive interface shown displays recommendation prompt information based on the first music, helping the user to adjust the first music more reasonably.

[0126] Of course, users can also enter the editing interface of music works, such as Fig. 7A As shown, adjust the prompt information in the editing interface. Fig. 7A Recommended prompt information will also be displayed on the editing interface shown.

[0127] For example, the first music is generated based on the first prompt information "The bird happily embraces the sky with its wings". Figure 3B The interactive interface shown or Fig. 7A The editing interface shown in the figure recommends prompt information such as the emotional type of the music "cheerful" and the theme type of the music "celebrating graduation". In this way, the user can more efficiently input the second prompt information for generating the second music based on the first prompt information and the recommended prompt information.

[0128] Regarding the adjustment of the basic properties of music, you can Figure 3C As shown in FIG. 1 , on the interactive interface with the intelligent agent, recommended adjustment information such as “faster tempo”, “change song style”, and “add lyrics” are displayed for the user to choose. Of course, the user can also directly input adjustment information such as “slower tempo” to adjust the tempo of the music.

[0129] Regarding the adjustment of the basic attributes of the music, the basic attributes of the music can also be displayed on the music editing interface, allowing the user to adjust the basic attributes of the music as a whole. Figure 7B As shown, the user can adjust the speed of the music by moving the speed adjustment control. Of course, the music can also be divided into multiple sections, supporting the user to adjust the basic properties of the music in sections.

[0130] Regarding the adjustment of the basic attributes of music, the music tracks can also be displayed for the user to adjust the basic attributes of the music by track. The adjustment of each track can be combined with the beat. For example, the duration of each beat in a certain track can be adjusted, and the combination rule of strong beats and weak beats in the track can also be adjusted.

[0131] To add lyrics and vocals to the first music, you can use Figure 5A , Figure 5B The process shown is carried out according to the adjustment information entered by the user; you can enter Fig. 7A , 7B After the editing interface is displayed, the adjustment operation is performed according to the user.

[0132] The lyrics can be generated by using the first prompt information for generating the first music, or the lyrics can be generated according to other prompt information different from the first prompt information. Of course, the lyrics can also be adjusted according to at least one of the melody, rhythm, and style of the music to obtain the second lyrics based on the first lyrics generated based on the first prompt information.

[0133] For vocal music, it is also necessary to generate a human voice that matches the music and lyrics, that is, the voice of the singer. Similarly, users can use their own voices as the voice of the singer. For example, using voice imitation technology, a human voice that matches the music and lyrics can be generated. Of course, a machine learning model can also be used to generate one or more human voices that match the music and lyrics for users to choose. To meet display needs, a title and cover corresponding to the music can also be generated.

[0134] Finally, the generated second music and its corresponding lyrics, vocals, title and cover are synthesized into a second music work and outputted in the interactive interface, such as playing the second music with vocals and displaying the title and cover. Figure 4C Perform operations such as publishing and sharing on the interactive interface shown.

[0135] The above is the music generation method provided by the embodiment of the present disclosure. Figure 9-11 A music generating device according to an embodiment of the present disclosure is described, which is used to execute any embodiment of the above-mentioned music generating method.

[0136] Fig. 9 A block diagram of a music generating device according to some embodiments of the present disclosure is shown.

[0137] like Fig. 9As shown, the music generating device 9 includes: a display module 91, configured to display guidance information for music generation on the interaction interface between the user and the intelligent agent in response to the music generation request of the user; a first output module 92, configured to output a first music work generated according to the first prompt information input by the user based on the guidance information, wherein the first prompt information includes description information of the music, and the first music work includes the first music; a second output module 93, configured to output a second music work generated according to the adjustment made by the user to the first music work, wherein the adjustment includes at least one of adjustment to the first prompt information and adjustment to the first music.

[0138] The display module 91 of the music generating device 9 can be used to execute Figure 1 Step S1 or Figure 8 Step S1'. The first output module 92 of the music generating device 9 can be used to perform Figure 1 Step S2 or Figure 8 Step S2'. The second output module 93 of the music generating device 9 can be used to perform Figure 1 Step S3 or Figure 8 Step S3'.

[0139] Fig.10 A block diagram of a music generating device according to some other embodiments of the present disclosure is shown.

[0140] like Fig.10 As shown, the music generating device 10 includes: a memory 101; and a processor 102 coupled to the memory 101, and the processor 102 is configured to execute the music generating method described in any of the aforementioned embodiments based on the instructions stored in the memory 101.

[0141] The memory 101 is used to store one or more computer-readable instructions. The memory 101 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), flash memory. The memory 101 may store, for example, an operating system, an application, a boot loader (BootLoader), a database, and other programs, and may also store various applications and various data.

[0142] The processor 102 is used to run computer-readable instructions to implement the music generation method described in any of the above embodiments. The specific implementation of each step of the music generation method can be found in the above embodiments, and the repeated parts are not repeated here.

[0143] The processor 102 may be configured to execute Figure 1 Step S1-Step S3 or Figure 8 The processor 102 may be embodied as various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc.

[0144] The processor 102 and the memory 101 may communicate with each other directly or indirectly. For example, the processor 102 and the memory 101 may communicate with each other via a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 102 and the memory 101 may also communicate with each other via a system bus, which is not limited in the present disclosure.

[0145] It should be noted that Fig.10 The components of the music generating device 10 shown are only exemplary and non-limiting. The music generating device 10 may also have other components according to actual application requirements. The processor 102 may control other components in the music generating device 10 to perform desired functions.

[0146] The music generating device can be implemented by software, firmware and / or hardware, and can be integrated into an electronic device installed with relevant application programs.

[0147] Fig.11 A block diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0148] Fig.11 The electronic device 11 shown may be a computer system with a dedicated hardware structure, which can execute corresponding functions when a relevant application program is installed.

[0149] Electronic devices include, but are not limited to, mobile terminals such as smart phones, laptops, personal digital assistants (PDA), tablet computers (Tablet Personal Computer, Tablet PC), PMP (portable multimedia player), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), wearable devices, etc., as well as fixed terminals such as digital televisions, desktop computers, etc.

[0150] like Fig.11As shown, a central processing unit (CPU) 111 performs various processes according to a program stored in a read-only memory (ROM) 112 or a program loaded from a storage section 118 to a random access memory (RAM) 113. In RAM 113, data required when CPU 111 performs various processes is stored as needed. The central processing unit is merely exemplary, and it may also be other types of processors, such as the various processors described above. ROM 112, RAM 113, and storage section 118 may be various forms of computer-readable storage media. It should be noted that although Fig.11 ROM 112, RAM 113 and storage section 118 are shown separately in FIG. 1 , but one or more of them may be combined or located in the same or different memory or storage modules.

[0151] The CPU 111, the ROM 112, and the RAM 113 are connected to each other via a bus 114. To the bus 114, an input / output interface 115 is also connected.

[0152] The following components are connected to the input / output interface 115: an input portion 116, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output portion 117, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage portion 118, including a hard disk, a magnetic tape, etc.; and a communication portion 119, including a network interface card such as a LAN card, a modem, etc. The communication portion 119 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Fig.11 The various devices or modules in the electronic device 11 are shown to communicate via the bus 114, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0153] A drive 1110 is also connected to the input / output interface 115 as needed. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 118 as needed.

[0154] When the series of processing described above is implemented by software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 1111 .

[0155] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which, when running on a computer, enables the computer to implement the music generation method described in any of the aforementioned embodiments. The computer program product includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 119, or installed from the storage part 118, or installed from the ROM 112. When the computer program is executed by the CPU 111, the music generation method of the embodiment of the present disclosure is executed.

[0156] It should be noted that, in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, apparatus or device or for use in conjunction with an instruction execution system, apparatus or device.

[0157] The computer readable medium may be a computer readable storage medium, or a computer readable signal medium, or any combination of the two.

[0158] Computer-readable storage media include, but are not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device or device. A computer program is stored on a computer-readable storage medium, and when the program is executed by a processor, the method for generating music described in any of the foregoing embodiments is implemented.

[0159] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer readable program codes. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than a computer readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0160] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0161] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute the music generation method of any of the above embodiments. For example, the instructions may be embodied as computer program codes.

[0162] In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).

[0163] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0164] The functions described above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0165] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A music generation method, comprising: On the interactive interface between the user and the agent, in response to the music generation request of the user, displaying guidance information for music generation; In response to first prompt information input by the user based on the guidance information, output a first musical work generated according to the first prompt information, wherein the first prompt information includes description information of the music, and the first musical work includes first music; In response to the user's adjustment to the first music piece, a second music piece generated according to the adjustment is output, wherein the adjustment includes at least one of an adjustment to the first prompt information and an adjustment to the first music piece.

2. The music generation method according to claim 1, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: receiving adjustment information of the user for basic attributes and / or style type of the first music, wherein the basic attributes include rhythm, melody, timbre, and harmony of the music; The second music piece generated according to the adjustment information is output, where the second music piece includes second music.

3. The music generation method according to claim 1, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: receiving adjustment information of lyrics added by the user to the first music; Output first lyrics generated according to the first prompt information and the first music as a part of the second music work.

4. The music generation method according to claim 1, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: receiving adjustment information of lyrics added by the user to the first music; Outputting first lyrics generated according to the first prompt information and the first music; receiving adjustment information of the user for the first lyrics; Second lyrics obtained based on the adjustment information are displayed as a part of the second musical work.

5. The music generation method according to claim 1, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: receiving adjustment information of adding vocals to the first music by the user; Providing timbres of multiple singers according to the adjustment information; Output the vocals generated according to the timbre of one or more singers selected by the user as part of the second musical work.

6. The music generating method according to claim 1, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: displaying an edit control for the first musical composition; In response to the user triggering the editing control, entering an editing interface for the first musical work; The second music piece is generated according to the adjustment operation of the user on the editing interface for the first music piece, wherein the adjustment operation includes at least one of an adjustment operation on the first prompt information and an adjustment operation on the first music.

7. The music generating method according to claim 6, wherein: Generating the second music piece according to the adjustment operation of the user on the editing interface on the first music piece includes: receiving a modification operation of the user on the first prompt information; Displaying second prompt information obtained based on the modification operation; The second musical work is generated according to the second prompt information by using a machine learning model.

8. The music generating method according to claim 7, wherein: In response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment comprises: Displaying at least one piece of recommendation prompt information based on the first music work, wherein the recommendation prompt information includes at least one of the theme of the music, the picture of the music, the emotional type of the music, and the style type of the music; The one or more pieces of recommendation prompt information selected by the user are used as part of the second prompt information.

9. The music generating method according to claim 8, wherein: The first music piece includes a plurality of sections, and in response to the user inputting an adjustment to the first music piece, outputting a second music piece generated according to the adjustment includes: The second music piece is generated according to the user's adjustment operation on basic attributes of at least one of the multiple sections of the first music piece, where the basic attributes include rhythm, melody, timbre, and harmony of the music.

10. The music generating method according to claim 9, wherein: Each of the plurality of sections includes a plurality of beats, and in response to the adjustment input by the user for the first musical work, outputting a second musical work generated according to the adjustment includes: displaying the audio track of the first music; The second music piece is generated according to the user's adjustment operation on the first music based on the audio track, and the adjustment operation on the first music includes at least one of adjusting the duration of the beat and adjusting the combination rule between the beats.

11. The music generating method according to claim 1, wherein: The guide information includes at least one candidate prompt template, each candidate prompt template corresponds to a complete music scene, and the information of each candidate prompt template includes at least one of the theme of music, the picture of music, the emotional type of music, and the style type of music; The prompt information in a candidate prompt template selected by the user serves as part or all of the first prompt information.

12. The music generating method according to claim 1, wherein: The guide information includes at least one candidate prompt information, and each candidate prompt information includes at least one of the theme of the music, the picture of the music, the emotional type of the music, and the style type of the music; The one or more pieces of candidate prompt information selected by the user serve as part or all of the first prompt information.

13. The music generating method according to any one of claims 1 to 12, wherein: The first musical work includes the title and cover of the first music; The second musical work includes the title and cover of the second music; The description information of the music includes at least one of the theme of the music, the picture of the music, the emotional type of the music, and the style type of the music.

14. A music generating device, comprising: A display module configured to display guidance information for music generation on an interactive interface between a user and an intelligent agent in response to a music generation request of the user; A first output module is configured to output a first music piece generated according to the first prompt information input by the user based on the guidance information, wherein the first prompt information includes description information of the music, and the first music piece includes first music; The second output module is configured to output a second music piece generated according to the adjustment made by the user to the first music piece, wherein the adjustment includes at least one of an adjustment to the first prompt information and an adjustment to the first music piece.

15. A music generating device, comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the music generating method according to any one of claims 1 to 13 based on instructions stored in the memory.

16. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the music generating method according to any one of claims 1 to 13.

17. A computer program product, when the computer program product is run on a computer, enables the computer to implement the music generation method according to any one of claims 1 to 13.

Citation Information

Cited By

  • Music generation method, music generation apparatus and computer-readable storage medium

    US12567395B2