Music generation method and device, computer equipment and storage medium

Abstract

The invention provides a music generation method and device, computer equipment and a storage medium. The method comprises the following steps: displaying a production interface in response to a music generation operation in an operation interface; the making interface comprises at least one music type option; in response to a first operation on any music type option, displaying at least one first classification corresponding to the any music type option on the production interface; in response to a second operation on any first classification, displaying at least one first sub-classification corresponding to the any first classification, and determining selection of the at least one first sub-classification so as to generate constraint information; and in response to a music generation operation, performing music generation according to the constraint information.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a music generation method, device, computer equipment and storage medium. Background Art

[0002] In recent years, with the rapid development of the Internet, generative artificial intelligence technology has gradually been applied to the creation of various types of media content, such as the generation and production of images, videos and other content.

[0003] With the popularization of generative artificial intelligence technology, more and more users want to generate and produce music content while producing images or videos. This poses certain challenges to the current production platforms that provide comprehensive generative artificial intelligence technology. Summary of the invention

[0004] In view of this, the present disclosure proposes a music generation method, apparatus, computer device and storage medium to solve or partially solve the above-mentioned problems.

[0005] Based on the above purpose, the present disclosure provides a music generation method in a first aspect, comprising:

[0006] In response to a music generation operation in the operation interface, a production interface is displayed; the production interface includes at least one music type option;

[0007] In response to a first operation on any music type option, displaying at least one first category corresponding to any music type option on the production interface;

[0008] In response to a second operation on any first category, displaying at least one first subcategory corresponding to the any first category, determining a selection of the at least one first subcategory, thereby generating constraint information;

[0009] In response to the music generation operation, music generation is performed according to the constraint information.

[0010] In a second aspect of the present disclosure, a music generating device is provided, comprising:

[0011] The first module is used to display a production interface in response to a music generation operation in the operation interface; the production interface includes at least one music type option;

[0012] A second module is used for displaying at least one first category corresponding to any music type option on the production interface in response to a first operation on any music type option;

[0013] A third module is used for, in response to a second operation on any first category, displaying at least one first subcategory corresponding to the any first category, determining a selection of the at least one first subcategory, thereby generating constraint information;

[0014] The fourth module is used to generate music according to the constraint information in response to the music generation operation.

[0015] In a third aspect of the present disclosure, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect is implemented.

[0016] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the first aspect.

[0017] From the above, it can be seen that the music generation method, device, computer equipment and storage medium provided by the present invention, by displaying a production interface for music generation on the user's operating interface, allows the user to generate music while producing images or videos, and when generating music, it is possible to set constraints for the generated music by selecting different categories and subcategories, so as to limit the type, timbre, musical instrument, scene and other elements of the generated music, so that the music can be more in line with the needs of the user, and provides users with more diverse functions for creation using generative artificial intelligence technology, significantly improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the drawings required for use in the embodiments or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A schematic diagram of an exemplary system according to an embodiment of the present disclosure is shown.

[0020] Figure 2 A schematic diagram of an exemplary operation interface according to an embodiment of the present disclosure is shown.

[0021] Figure 3A A schematic diagram of an exemplary production interface according to an embodiment of the present disclosure is shown.

[0022] Figure 3B A partial schematic diagram of a functional area of ​​an exemplary production interface according to an embodiment of the present disclosure is shown.

[0023] Figure 3C A partial schematic diagram of a functional area of ​​another exemplary production interface according to an embodiment of the present disclosure is shown.

[0024] Figure 3D A partial schematic diagram of a functional area of ​​another exemplary production interface according to an embodiment of the present disclosure is shown.

[0025] Figure 3E A partial schematic diagram of a functional area of ​​another exemplary production interface according to an embodiment of the present disclosure is shown.

[0026] Figure 3F A partial schematic diagram of a first display area of ​​an exemplary production interface according to an embodiment of the present disclosure is shown.

[0027] Figure 3G A partial schematic diagram of a second display area of ​​an exemplary operation interface according to an embodiment of the present disclosure is shown.

[0028] Figure 3H A schematic diagram of a music playback suspension area of ​​an exemplary operating interface according to an embodiment of the present disclosure is shown.

[0029] Figure 4 A flowchart of an exemplary method according to an embodiment of the present disclosure is shown.

[0030] Figure 5 A schematic diagram of an exemplary apparatus according to an embodiment of the present disclosure is shown.

[0031] Figure 6 A schematic diagram of an exemplary computer device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of this specification more clear, this specification is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0033] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the examples of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Including" or "including" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0034] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0035] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0036] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0037] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0038] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0039] In order to make the purpose, technical solutions and advantages of this specification more clear, this specification is further described in detail below in combination with specific examples and with reference to the accompanying drawings.

[0040] Figure 1 A schematic diagram of an exemplary system 100 according to an embodiment of the present disclosure is shown. The system 100 may be a system for implementing music generation.

[0041] like Figure 1 As shown, taking the case where a terminal device and a server jointly execute the object display method as an example, the system 100 may include a terminal device 102, a server 104, and a database server 106. The terminal device 102 and the server 104 are connected via a network, such as a wired or wireless network connection. Optionally, the device for implementing music generation may be integrated in the terminal device 102. The database server 106 and the server 104 are connected via a network, such as a wired or wireless network connection. The database server 106 may store various data related to the execution of the music generation method, such as music parameters, generation algorithms, and the like.

[0042] The terminal device 102 may be installed with various applications (Application, APP, Chinese abbreviation: application), such as music processing applications, video conferencing applications, life service applications, reading applications, video applications, social applications, payment applications, web browsers and instant messaging tools, etc., all of which can be used to generate music and / or display / play the generated music. As an optional example, the application (APP) installed on the terminal device 102 can be downloaded and installed from the server 104.

[0043] The terminal device 102 here can be hardware or software. When the terminal device 102 is hardware, it can be various electronic devices with a display screen, including but not limited to smart phones, tablet computers, e-book readers, MP3 players, laptop computers (Laptops) and desktop computers (PCs), etc. When the terminal device 102 is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, to provide distributed services), or it can be implemented as a single software or software module, which is not specifically limited here.

[0044] The server 104 may be a server that provides various services. For example, it may be a background server that provides support for various applications displayed on the terminal device 102. The database server 106 may also be a database server that provides various services. It is understood that if the server 104 can implement the relevant functions of the database server 106, the database server 106 may not be provided in the system 100.

[0045] Here, the server 104 and the database server 106 can also be hardware or software. When they are hardware, they can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When they are software, they can be implemented as multiple software or software modules (for example, to provide distributed services), or as a single software or software module. No specific limitation is made here.

[0046] It should be noted that the music generation method provided by the example of the present disclosure can be executed by the system 100. Specifically, it can be executed interactively between the terminal device 102, the server 104 and the database server 106. It is understood that in the case where the terminal device 102 has the functions required by the server 104 and the database server 106 to execute the music generation method, the terminal device 102 can also execute it alone. It should be understood that Figure 1 The number of terminal devices 102, servers 104, database servers 106 and users 108 in the figure is only for illustration. According to actual needs, there may be any number of terminal devices, users, servers and database servers.

[0047] In an exemplary application scenario, the user 108 may input instructions for making music through the terminal device 102 , and the server 104 may provide the user 108 with a music generation service based on the instructions, and display the operation interface of the music generation service on a page through the terminal device 102 .

[0048] As described in the background technology, in some examples, users can make and produce a variety of products, such as pictures, videos, etc., by applying generative artificial intelligence technology. Users can use generative artificial intelligence (AIGC, Artificial Intelligence Generated Content) to generate images. After users have successfully experienced visual products using generative artificial intelligence technology, they gradually hope to get corresponding help on auditory products, that is, users begin to have corresponding needs for the generation and production of music content. After learning from the corresponding settings of image generation, corresponding music generation tools can be developed to perform music generation work. In some examples, the music generation tool can be presented to users in the form of an independent APP; it can also be integrated in the platform of generative artificial intelligence technology to provide users with choices. The platform can provide users with a variety of generation services, such as image generation, video generation, story generation, and music generation, etc. It is not specifically limited here.

[0049] In some examples, the music generation tool may be software or a program with a music generation function. However, this is not specifically limited here. Specifically, any tool that has a music generation capability and completes intelligent music generation through interaction with an operator may be considered a music generation tool.

[0050] In a more specific scenario, when using a platform with generative artificial intelligence technology, user 108 can generally generate products such as image generation and video generation. It is understandable that in this scenario, as user needs gradually increase, users will gradually become dissatisfied with only being able to generate images or videos, and on this basis, they also hope to be able to generate and produce music content, which poses certain challenges to the current production platform that provides comprehensive generative artificial intelligence technology.

[0051] Figure 2 A schematic diagram of an exemplary operation interface 200 according to an embodiment of the present disclosure is shown.

[0052] like Figure 2 As shown, the operation interface 200 can be the homepage interface of a platform that provides generative artificial intelligence technology. Such platforms generally provide corresponding services for each user, so the homepage interface here can be the user's personal homepage interface. Of course, in some other examples, the operation interface 200 can also be a public platform homepage, etc. After that, taking the operation interface 200 as the user's personal homepage interface as an example, the operation interface 200 can be a page of the user's homepage of the platform such as an image processing application, a small program or a website page. The user 108 can open the application or small program corresponding to the platform in the terminal device 102, or enter the website of the corresponding platform through the website program, and then the operation interface 200 can be displayed on the terminal device 102. It can be understood that there are many ways to enter the operation interface 200, and here it is only to illustrate more clearly and describe the possible entry methods.

[0053] like Figure 2 As shown, after entering the operation interface 200, corresponding ports for image generation and video generation can be set in the corresponding function area, for example, corresponding operation ports (such as Figure 2Afterwards, some products can be displayed in the main area 203 of the operation interface 200, for example, products that the user has made, followed or purchased can be displayed, and corresponding products can also be recommended and displayed according to the user's settings and / or the platform's recommendation algorithm. Through the operation interface 200, users can easily generate images, videos, and text works. Furthermore, as user needs expand, more and more users hope to be able to produce corresponding music works while using the operation interface 200.

[0054] Combined with the above actual situation, Figure 2 As shown, in some examples, in order to give users more interactive options, especially music production functions, thereby providing users with more diverse functional capabilities, firstly, a corresponding music generation control area can be set on the operation interface 200, such as Figure 2 As shown, an operation area for music generation may be set in the function area 201 and / or the function area 202, such as Figure 2 The music generation button area in the control. The user can select the control area by clicking the area (music generation) to perform a music generation operation, thereby triggering the workflow of music generation.

[0055] It should be noted that the selection operation in this example and the following examples may be an operation with a clear trigger signal such as single click, double click, touch, etc. on the object. This is only an exemplary description and is not specifically limited to this.

[0056] like Figure 3A As shown, after the user performs the music generation operation, the production interface 300 can be displayed in the operation interface 200. The interface can be a brand new window; or the operation interface 200 can be replaced with the production interface 300 based on the original operation interface 200. The production interface 300 can include multiple areas, including a functional area 301 for performing music generation operations, and a display area 302 for displaying generated works. The display area 302 can only include music works corresponding to the current production interface 300, and can also include other works produced by the current user, such as image works and video works produced by the current user. Afterwards, the display form of the functional area 301 and the display area 302 in the production interface 300 can be as follows. Figure 3AThe function area 301 shown occupies the left part of the entire interface, while the display area 302 occupies the middle and right parts of the interface; the function area 301 may also occupy the upper part, and the display area 302 may occupy the middle and lower part of the interface; or in different specific scenarios, the size, shape and position of the above two areas can be adjusted in the entire production interface 300 as needed, which is not specifically limited here.

[0057] Further, only a partial area of ​​the functional area 301 is first described. FIG. 3B to FIG. 3E A partial schematic diagram of a functional area 301 of an exemplary production interface 300 according to an embodiment of the present disclosure is shown.

[0058] Afterwards, if Figure 3A As shown, at least two music type options 310 are displayed in the production interface 300, specifically, songs with lyrics 310A and pure music 310B. In other specific scenarios, other options can be set according to the needs of the scenario, or the number of music type options 310 can be increased or decreased, that is, at least one music type option 310 is included in the production interface 300. Taking the music type options 310 as songs with lyrics 310A and pure music 310B as an example, after entering the production interface 300, you can select songs with lyrics 310A and pure music 310B (the first operation). After selecting one of them, the content corresponding to the selected option can be displayed in the production interface 300. Figure 3A As shown, when the user selects the song with lyrics 310A, the content corresponding to the song with lyrics 310A can be displayed in the production interface 300. In a more specific scenario, in order to highlight the selected option, the selected option can be displayed differently, such as by highlighting, enlarging, adjusting the color, etc., or Figure 3A As shown, the corresponding options are displayed by underlining them. Then, in a more specific scenario, for at least one music type option 310, the corresponding options can be displayed in sequence in the function area 301, or only some of the music type options 310 can be displayed according to the size of the function area 301, and the others can be omitted, and the omitted music type options 310 can be displayed by sliding.

[0059] In some examples, first, taking the song with lyrics 310A as an example, after the first operation is performed on the song with lyrics 310A, the content corresponding to the song with lyrics 310A can be displayed in the production interface 300, specifically in the function area 301, and specifically can include at least one first category 320. The first category 320 here is mainly used to form corresponding constraints on music generation, such as Figure 3AAs shown, the style, instrument, scene, etc. of the music can be specifically limited. For example, after the style is specifically limited to "Jazz", the generated music will be based on jazz as the standard, and no other styles of music will be generated. After selecting a first category 320, at least one first subcategory 330 belonging to the first category 320 can be displayed more specifically. For example, after selecting the first category "Style", at least one first subcategory 330 can continue to be displayed in the function area 301. These first subcategories can be specific subdivision options of the selected first category 320. Afterwards, at least one first subcategory 330 can be selected at least once to generate constraint information. Here, the number of first subcategories 330 that can be selected in each first category 320 can be limited, for example, it can be limited to only 1, 3, etc. in one category, or the total number of selected categories can be limited, for example, a total of 10, 12 categories can be selected as constraints, etc. Here, for the scenario of selecting multiple, taking the "style" classification as an example, if 2 or more are selected, one of the selected styles can be selected to generate music, or the generated music style can include all or part of the styles. Here, it should be noted that the selection operation of any first classification can be considered as the second operation of any first classification, and in some other examples, similar to the aforementioned first operation, the second operation (or the first operation) can be a selection operation, and the selection operation is not necessarily the second operation (or the first operation). In different scenarios, other operations can also be the second operation (or the first operation) as long as they meet the corresponding settings and needs, and are not specifically limited here. Afterwards, in a more specific scenario, for the first classification 320 and the first sub-classification 330, similar settings can also be made as the music type option 310, that is, the corresponding options can be displayed in sequence in the function area 301, or only part can be displayed according to the size of the function area 301, and the others can be omitted, and the omitted classification can be displayed by sliding or the like.

[0060] The selected category or subcategory can also be displayed in a manner different from other unselected categories, that is, the selected items can be displayed in a manner of being displayed differently. Of course, in some examples, a separate area can be set to display different selected subcategories, for example Figure 3A As shown, a selection area 304 may be set, and when a subcategory 330 is selected, the selected subcategory may be displayed in the selection area 304 .

[0061] In a more specific scenario, when the user enters the production interface 300, a music type option 310 and the specific content of a first category 320 of the music type option 310 can be displayed in the function area 301 by default. When the user selects other music type options 310, the content in the function area 301 can be adjusted.

[0062] Further, after the first category 320 and the first subcategory 330 are selected, corresponding constraint information can be generated according to the selected content to provide constraints for music generation. Afterwards, the final music generation operation can be performed through the corresponding music generation operation. Here, the music generation operation, such as Figure 3A As shown, the music generation operation can be performed by selecting the trigger area of ​​"music generation", and the music generation operation can be used to confirm and submit the operation in the function area 301, and perform the related operation of music generation. In this way, the constraint information generated according to the above is provided to the model or algorithm used for music generation, and the corresponding music generation work is performed.

[0063] It should be noted that, regardless of whether the generated music is pure music or a song with lyrics, it is not necessarily necessary to obtain the corresponding lyrics information (or text information). In some examples, even if you choose to generate a song with lyrics, it is not necessary to fill in the lyrics, but you can use the corresponding model to automatically generate them, for example Figure 3A As shown, for the song with lyrics 310A option, although a text area 303 for inputting text information is provided, it is not mandatory to fill in this area. When performing music generation operations, if there is no content in the text area 303, it can be automatically generated and filled in through the corresponding model and algorithm. Similarly, for pure music, a corresponding text input area, i.e., text area 303, can also be provided to describe the music to be generated, thereby forming another form of constraint. For example, for pure music, the input text information can be used as a more detailed limitation on the scene of the music, etc., so as to impose more specific constraints when generating music or serve as a reference to assist in the generation of music. Figure 3C As shown, for the pure music option, a text area 303 can also be set, which allows the user to enter text information to limit the music to be generated. Of course, this part can also be automatically generated (such as by triggering Figure 3C The “Inspiration Generation” functional area shown).

[0064] Furthermore, in some examples, the text area 303 may or may not be set. Of course, in order to better allow users to express their ideas about music, the text area 303 may be set in the production interface 300, and specifically, the text area 303 may be set in the function area 301. The content of the area may then be determined by obtaining the text input of the user to the area; or a piece of text information may be automatically generated in the text area 303 through the user's third operation on the area. The third operation here may be understood as an indication operation for automatic generation, which may be performed by a corresponding function key or area (such as Figure 3A It may also be triggered directly by a corresponding gesture operation or stroke operation, for example, a certain touch track or mouse track is set to directly trigger automatic text generation in the text area 303. In the process of automatically generating text information, if the text area 303 itself contains text, these texts can be used as references or ignored.

[0065] In some examples, for the selection of at least one first sub-category 330, the selected first sub-category 330 may be displayed in the text area 303 in addition to being displayed in the selection area 304. Figure 3D and 3E As shown, it is an example that a selected first sub-category 330 is displayed in the selection area 304 and the text area 303 respectively.

[0066] Furthermore, for songs with lyrics, in the text area 303, corresponding input can be made more professionally according to the common structure of the song, so that the generated music can be more in line with the needs of the user. Specifically, Figure 3B As shown, the user can limit the specific structure by entering the set structure prompt. In the example, the structure prompt is specifically the " / " symbol. Of course, other structure prompts can also be set in other examples, and this is not specifically limited. After that, when the user enters the corresponding structure prompt, the prompt information can be called up, and the user can make a selection or directly enter according to the corresponding rules. Figure 3BAs shown, after inputting " / ", a prompt area can be formed on the side of the structure prompt, and prompt information is displayed in the prompt area. The user can select the prompt information (the fourth operation), such as selecting the prelude (Intro) in the prompt information, or directly input the corresponding information according to the prompt information, such as directly inputting the prelude after the " / ". After that, the corresponding structure word (such as the aforementioned prelude (Intro)) can be displayed in the text area 303, and the content after the structure word is considered to be the limitation or description of the part referred to by the structure word. That is, according to the fourth operation on the prompt information or the acquisition of the input information corresponding to the prompt information, the structure word is displayed in the text area, and the input text after the structure word is used as the specific content of the structure word; wherein the structure word corresponds to the specific content of the prompt information determined by the fourth operation, or corresponds to the specific content of the prompt information corresponding to the input information.

[0067] Afterwards, for the example in which a text area 303 is set, if there is text information in the text area 303 when performing a music generation operation, then this text information can be used as a constraint, merged into the constraint information, and input into the corresponding music generation model or algorithm to constrain the music generation.

[0068] Furthermore, the first category and the first subcategory are described in more detail, such as Figure 3A As shown, a classification display area 305 can be further set in the production interface 300, and can be specifically set in the function area 301. The first category 320 and the first subcategory 330 are displayed in the classification display area 305. Afterwards, a selection method for the first category 320 and the first subcategory 330 has been partially described in the above example, that is, the various options of the first category 320 can be displayed in the classification display area 305 first, and when the user selects one of the first categories 320, the first subcategory 330 corresponding to the first category 320 continues to be displayed in the classification display area 305. Afterwards, after the user makes a selection, the selected category can be displayed separately, or it can be displayed in other areas (such as the selection area 304 or the text area 303).

[0069] In another example, FIG. 3C to FIG. 3E As shown, only the first categories 320 can be displayed in the category display area 305. After the user selects one of the first categories 320, the display of the first category 320 is canceled in the category display area 305, and only the first sub-category 330 corresponding to the selected first category 320 is displayed. FIG. 3C to FIG. 3EAfter the first category 320 of “Dance Music” is selected, other first categories in the category display area 305 are cancelled (which can be understood as being unselectable). After that, only the first subcategory 330 corresponding to the first category 320 of “Dance Music” is further displayed in the category display area 305 .

[0070] Furthermore, for such a selection method, multiple cycles can be performed, that is, after completing the selection of the first category 320, the first subcategory 330 corresponding to the selected first category 320 is displayed, and after selecting a first subcategory 330, only the second subcategory corresponding to the selected first subcategory 330 can be further displayed, and after selecting a second subcategory, only the third subcategory corresponding to the selected second subcategory is displayed, and so on and so forth, until the number of selected categories or options reaches a preset condition (for example, the bottom-level category is reached or the number of selected categories reaches a certain number, etc.), or the user stops selecting and triggers a music generation operation, etc.

[0071] For songs with lyrics, the length of the song generally corresponds to the length of the lyrics, so there is no need to set the corresponding song length. However, for pure music without lyrics, it may be necessary to limit the song length. FIG. 3C to FIG. 3E As shown, the music type option 310 may further include a pure music option 310B, and in the function area 301 corresponding to the pure music option 310B, a duration input area (the music duration part in the figure) may be further displayed, and the user may set the music duration by inputting in this area. The specific duration input area may be in the form of a text box, and the user may input a specific time in the text box; or FIG. 3C to FIG. 3E As shown, the time is selected by dragging the input in the form of a drag bar. Of course, the set time can be displayed next to the drag bar. It can also be a time setting method in the form of a roller. Set the setting roller for minutes, seconds, etc. in the duration input area, and set the specific time by rolling the roller.

[0072] Finally, for music generation, the input ports of song titles and song covers can be further set, for example, corresponding input areas can be set in the function area 301. Of course, similar to the lyrics, for the song title and song cover, it is also possible not to input them, but to let the music generation model directly generate them with the help of corresponding modules. Specifically, the corresponding generation work can be performed according to the constraint information, and the constraint information may or may not contain text information. That is, in some examples, music generation is performed according to the constraint information, including at least one of generating music songs, generating music song titles, and generating music covers. In more specific scenarios, whether it is the automatic generation of lyrics, or the generation of song titles or covers, it may cause the generation failure due to reasons such as insufficient content; or these automatically generated contents need to be subject to certain audits, if they cannot pass the audit, it may also cause the generation failure. When the generation failure occurs, the user can be prompted by forming corresponding prompt information.

[0073] At this point, the music generation part is completed. The generated music works can be displayed in the display area 302 of the production interface 300. Specifically, Figure 3A As shown, a work can be displayed in the first display area 306 in the display area 302. For the first display area 306, more specifically, Figure 3F As shown, at least part of the information of the music can be displayed in the first display area 306, such as the song cover, text information in the constraint information, etc. Then, the user's selection of the music type option, the first category, and the first sub-category is actually the setting of the nature of the music, and then the contents of these options or categories can be displayed in the first display area 306 in sequence, or only part of them or none of them can be displayed in order to save space. For the above information that is not displayed, a trigger area 306A (or it can be called an expansion mark) can be set. When the trigger area 306A is triggered by selection, hovering, etc., the above information can be displayed separately. Figure 3F As shown, only the logo corresponding to the music type option is displayed after the text information, and other categories are not displayed. Instead, an expansion logo 306A of "song style" is set. When the user triggers the area through selection or hovering, specific information that was not displayed before can be displayed in the form of a display box popping up on one side.

[0074] Furthermore, if Figure 3FAs shown, in order to facilitate the re-editing of the musical work, a re-editing mark 306B can be set for the first display area 306. By triggering the re-editing mark 306B, the musical work can be re-edited, and the setting attribute corresponding to the musical work is called out in the function area 301 again, so as to re-edit the musical work. Similarly, the same setting as the musical work shown in the first display area 306 can also be used to generate a musical work again through the music generation model or algorithm, that is, to re-generate a musical work through the music generation model or algorithm using the same constraint information. And due to the setting of the music generation model or algorithm itself, even if the input is completely consistent, its output may not be quite the same, so that at least one musical work can be generated using the same constraint information. And in order to realize such function, a re-generation mark 306C can be set for the first display area 306. By triggering the re-generation mark 306C, the same constraint information as the musical work shown in the first display area 306 can be used to generate music again.

[0075] In some examples, similar to the first display area 306 described above, finished works can also be displayed in the operation interface 200. Figure 2 As shown, the finished work can be displayed in the main area 203, wherein the finished music work can be displayed in the second display area 307. Figure 3G As shown, it is a specific structural diagram of the second display area 307. The second display area 307 is mainly used to display the work information. Specifically, for the finished music work, it can display the music cover of the finished music work, as well as the song name, author and other song information. The user can view more detailed information by clicking on this information. Afterwards, it is more important for the finished music work to be able to play so that the user can hear the specific content of the work. Then, the second display area 307 may include a first area 307A. When the user triggers this area (for example, clicks, etc.), the music work can be played. At the same time, the first area 307A can also display information such as the song cover, or display the corresponding lyrics when playing music.

[0076] Further, after the user enjoys the works in the second display area 307, in order to meet the user's desire to make works similar to the finished music works in the second display area 307, or to further modify and adjust the work on the basis of the work. The second area 307B can be set in the second display area 307. By triggering the area (such as clicking, etc.), the attribute information corresponding to the finished music work can be directly displayed on the operation interface 200 or displayed by creating a new window. The displayed information form or typesetting form can be similar to the functional area 301 of the production interface 300, only filling in or selecting the constraint information corresponding to the finished music work displayed in the second display area 307 between the corresponding parts. At the same time, the area in the newly generated area corresponding to the trigger area of ​​"music generation" in the functional area 301 is the third area, and the specific third area can be a trigger area such as "make the same style". After the user has viewed the displayed constraint information, if he wants to further "make the same style" or make improvements on it, he can trigger the third area (select operation). After triggering the third area, you can jump to the production interface 300, and adjust the text area, classification display area, etc. according to the constraint information of the finished music work to make them consistent with the constraint information of the finished music work, and then accept the user's adjustment, or directly perform music generation operations.

[0077] In some examples, the main area 203 of a general operation interface 200 will contain a lot of information about works, and it may be slidable or scrollable. After the user plays a finished music on the operation interface 200, if the main area 203 slides or scrolls, the second display area 307 corresponding to the finished music work being played exceeds the display range of the main area 203 or the display range of the operation interface 200, then the display of the music work can be terminated by stopping the playback, for example, it can be stopped directly; or after exceeding the display range, it can slowly fade out within a set time and finally stop. However, in more scenarios, users generally do not want the music work to stop being displayed, so when there is no second display area 307 corresponding to the finished music work, it is necessary to set a corresponding controller to control the music work. In this way, when the second display area 307 exceeds the display range of the operation interface 200, a music playback floating area 308 can be displayed on the operation interface 200. Figure 2 As shown, the music playback suspension area 308 on the operation interface 200 can be set at any position of the interface, such as the lower right corner. Specifically, the form of the music playback suspension area 308 can be as follows: Figure 3HAs shown, the music playback suspension area 308 can be set at any position of the operation interface 200, and the user can move or resize it. Afterwards, for the functions that can be realized, first, the fourth area 308A where the second display area 307 corresponding to the music work is located can be jumped back. When the user triggers this area, the operation interface 200 will directly jump to the second display area 307 corresponding to the finished music work, and cancel the music playback suspension area 308. At the same time, the cover, playback progress and other information of the music work can be displayed in the fourth area 308A. Afterwards, the music playback suspension area 308 can also be set to control whether the music is played, or to control the control area of ​​the corresponding music attribute, that is, the fifth area 308B. When the user triggers this area, according to the different function keys of the area triggered by the user, the music work can be played, paused, and stopped, and the volume can be adjusted, fast forward and rewind, etc., or the previous work, the next work, etc. can be adjusted. Afterwards, the music playing suspension area 308 can also be provided with a sixth area 308C for closing the music playing suspension area 308. By triggering (selecting, clicking, etc.) this area, the music playing suspension area 308 can be canceled and the playing of the corresponding finished music can be stopped at the same time.

[0078] In some more specific scenarios, a music playlist can be generated based on the content of the works in the main area 203 of the operation interface 200 and played in a loop, and the music works corresponding to the music playback suspension area 308 can be changed according to the changes in the played music.

[0079] Furthermore, the music playing suspension area 308 is provided so as to control the music work when the second display area 307 of the finished music work being played exceeds the display range, and then when the second display area 307 corresponding to the finished music work re-enters the display range, there is no need to display the music playing suspension area 308, and it can be cancelled. Or the user has selected other finished music works and hopes to play the selected finished music works, at this time, the current finished music can be stopped and the selected finished music works can be played. At the same time, since the second display area 307 corresponding to the selected finished music work must be within the display range when the user makes a selection, there is no need to display the music playing suspension area 308, and it can also be cancelled.

[0080] at last, Figure 4 A flowchart of an exemplary method 400 according to an embodiment of the present disclosure is shown.

[0081] The method 400 is used for music generation and can be implemented by the terminal device 102 alone or by the system 100. Figure 4As shown, method 400 may include the following steps.

[0082] Step 402, in response to the music generation operation in the operation interface, displaying a production interface; the production interface includes at least one music type option.

[0083] Step 404, in response to a first operation on any music type option, displaying at least one first category corresponding to any music type option on the production interface.

[0084] Step 406, in response to the second operation on any first category, display at least one first subcategory corresponding to the any first category, determine the selection of the at least one first subcategory, and thereby generate constraint information.

[0085] Step 408, in response to the music generation operation, music generation is performed according to the constraint information.

[0086] In some exemplary embodiments, after responding to a first operation on any music type option, the method further includes:

[0087] Displaying a text area on the production interface;

[0088] Acquire input text information through the text area;

[0089] or

[0090] In response to a third operation being performed in the text area, the text information is automatically generated in the text area.

[0091] In some exemplary embodiments, the generating music according to the constraint information includes:

[0092] In response to the existence of the text information, the music generation is performed together with the text information as a constraint.

[0093] In some exemplary embodiments, the acquiring the input text information through the text area includes:

[0094] In response to obtaining a preset structure prompt, displaying prompt information corresponding to the structure prompt;

[0095] According to a fourth operation on the prompt information or obtaining input information corresponding to the prompt information, a structure word is displayed in the text area, and the input text after the structure word is used as the specific content of the structure word; wherein the structure word corresponds to the specific content of the prompt information determined by the fourth operation, or corresponds to the specific content of the prompt information corresponding to the input information.

[0096] In some exemplary embodiments, the production interface includes a category display area; the displaying at least one first subcategory corresponding to any one of the first categories includes:

[0097] According to the second operation, the selected any one of the first categories is determined, and all first subcategories corresponding to the any one of the first categories are displayed in the category display area.

[0098] In some exemplary embodiments, the production interface includes a category display area; the displaying at least one first subcategory corresponding to any one of the first categories includes:

[0099] canceling the display of the at least one first category in the category display area, and displaying the at least one first subcategory in the category display area;

[0100] In response to the selection of any first subcategory, the display of at least one first subcategory is canceled in the category display area, and a second subcategory corresponding to the selected first subcategory is displayed in the category display area, and this cycle is repeated until the number of selected options reaches a preset condition, or a music generation operation is obtained.

[0101] In some exemplary embodiments, the music type options include at least a pure music option;

[0102] After responding to the first operation on any music type option, the method further includes:

[0103] In response to the first operation determining that the pure music option is the one, a duration input area is displayed on the production interface so that the music duration can be set through the duration input area.

[0104] In some exemplary embodiments, the generating of music according to the constraint information includes at least one of generating a music song, generating a music song title, and generating a music cover.

[0105] In some exemplary embodiments, after generating music according to the constraint information, the method further includes:

[0106] A first display area for displaying generated music on the production interface;

[0107] Displaying the content of the constraint information in sequence in the first display area;

[0108] or

[0109] At least part of the content of the constraint information and an expansion mark are displayed in the first display area; wherein the expansion mark is used to display the omitted content of the constraint information when triggered.

[0110] In some exemplary embodiments, after generating music according to the constraint information, the method further includes:

[0111] A first display area for displaying generated music on the production interface;

[0112] A re-editing mark and / or a re-generating mark is added to the first display area.

[0113] In some exemplary embodiments, the operation interface further includes: a second display area for displaying finished music; the second display area includes at least a first area and a second area;

[0114] In response to a triggering operation on the first area, playing the finished music;

[0115] In response to a triggering operation on the second area, displaying constraint information corresponding to the finished music and a third area;

[0116] In response to a triggering operation on the third area, the production interface is displayed, and the production interface is adjusted according to the constraint information corresponding to the finished music.

[0117] In some exemplary embodiments, the operation interface further includes: a music playback suspension area; the music playback suspension area includes at least one of a fourth area, a fifth area, and a sixth area;

[0118] After playing the finished music, the method further includes:

[0119] In response to the second display area exceeding the display range of the operation interface, displaying the music playback suspension area on the operation interface;

[0120] In response to a triggering operation on the fourth area, redisplaying the second display area in the display range of the operation interface, and canceling the music playing suspension area;

[0121] In response to the triggering operation on the fifth area, controlling the playing state of the finished music and / or adjusting the playing attributes;

[0122] In response to the triggering operation on the sixth area, the music playing suspension area is closed and the playing of the finished music is stopped.

[0123] In some exemplary embodiments, after displaying the music playback floating area on the operation interface, the method further includes:

[0124] In response to the second display area re-entering the display range of the operation interface or receiving a selection of other finished music, the music playback suspension area is cancelled.

[0125] It can be seen from the above embodiments that the music generation method provided by the embodiments of the present disclosure, by displaying a production interface for music generation on the user's operating interface, allows the user to generate music while producing images or videos, and when generating music, it is possible to set constraints for the generated music by selecting different categories and subcategories, so as to limit the type, timbre, musical instruments, scenes and other elements of the generated music, so that the music can be more in line with the needs of the user, and provides users with more diverse functions for creation using generative artificial intelligence technology, significantly improving the user experience.

[0126] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the embodiment of the present disclosure can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.

[0127] It should be noted that the above describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above examples and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0128] Based on the same technical concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a music generating device.

[0129] refer to Figure 5 , the music generating device 500 comprises:

[0130] The first module 510 is used to display a production interface in response to a music generation operation in the operation interface; the production interface includes at least one music type option.

[0131] The second module 520 is used to display at least one first category corresponding to any music type option on the production interface in response to a first operation on any music type option.

[0132] The third module 530 is used to display at least one first sub-category corresponding to any first category in response to the second operation on the any first category, determine the selection of the at least one first sub-category, and generate constraint information.

[0133] The fourth module 540 is used to generate music according to the constraint information in response to the music generation operation.

[0134] In some exemplary embodiments, the second module 520 is further configured to:

[0135] Displaying a text area on the production interface;

[0136] Acquire input text information through the text area;

[0137] or

[0138] In response to a third operation being performed in the text area, the text information is automatically generated in the text area.

[0139] In some exemplary embodiments, the fourth module 540 is further configured to:

[0140] In response to the existence of the text information, the music generation is performed together with the text information as a constraint.

[0141] In some exemplary embodiments, the second module 520 is further configured to:

[0142] In response to obtaining a preset structure prompt, displaying prompt information corresponding to the structure prompt;

[0143] According to a fourth operation on the prompt information or obtaining input information corresponding to the prompt information, a structure word is displayed in the text area, and the input text after the structure word is used as the specific content of the structure word; wherein the structure word corresponds to the specific content of the prompt information determined by the fourth operation, or corresponds to the specific content of the prompt information corresponding to the input information.

[0144] In some exemplary embodiments, the production interface includes a classification display area; the third module 530 is further used to:

[0145] According to the second operation, the selected any one of the first categories is determined, and all first subcategories corresponding to the any one of the first categories are displayed in the category display area.

[0146] In some exemplary embodiments, the production interface includes a classification display area; the third module 530 is further used to:

[0147] The display of the at least one first category is canceled in the category display area, and the at least one first subcategory is displayed in the category display area.

[0148] In response to the selection of any first subcategory, the display of at least one first subcategory is canceled in the category display area, and a second subcategory corresponding to the selected first subcategory is displayed in the category display area, and this cycle is repeated until the number of selected options reaches a preset condition, or a music generation operation is obtained.

[0149] In some exemplary embodiments, the music type options include at least a pure music option;

[0150] The second module 520 is further configured to:

[0151] In response to the first operation determining that the pure music option is the one, a duration input area is displayed on the production interface so that the music duration can be set through the duration input area.

[0152] In some exemplary embodiments, the fourth module 540 generates music according to the constraint information, including at least one of generating a music song, generating a music song title, and generating a music cover.

[0153] In some exemplary embodiments, the fourth module 540 is further configured to:

[0154] A first display area for displaying generated music on the production interface;

[0155] Displaying the content of the constraint information in sequence in the first display area;

[0156] or

[0157] At least part of the content of the constraint information and an expansion mark are displayed in the first display area; wherein the expansion mark is used to display the omitted content of the constraint information when triggered.

[0158] In some exemplary embodiments, the fourth module 540 is further configured to:

[0159] A first display area for displaying generated music on the production interface;

[0160] A re-editing mark and / or a re-generating mark is added to the first display area.

[0161] In some exemplary embodiments, the operation interface further includes: a second display area for displaying finished music; the second display area includes at least a first area and a second area;

[0162] In response to a triggering operation on the first area, playing the finished music;

[0163] In response to a triggering operation on the second area, displaying constraint information corresponding to the finished music and a third area;

[0164] In response to a triggering operation on the third area, the production interface is displayed, and the production interface is adjusted according to the constraint information corresponding to the finished music.

[0165] In some exemplary embodiments, the operation interface further includes: a music playback suspension area; the music playback suspension area includes at least one of a fourth area, a fifth area, and a sixth area;

[0166] After playing the finished music, the method further includes:

[0167] In response to the second display area exceeding the display range of the operation interface, displaying the music playback suspension area on the operation interface;

[0168] In response to a triggering operation on the fourth area, redisplaying the second display area in the display range of the operation interface, and canceling the music playing suspension area;

[0169] In response to the triggering operation on the fifth area, controlling the playing state of the finished music and / or adjusting the playing attributes;

[0170] In response to the triggering operation on the sixth area, the music playing suspension area is closed and the playing of the finished music is stopped.

[0171] In some exemplary embodiments, after displaying the music playback suspension area on the operation interface, the method further includes:

[0172] In response to the second display area re-entering the display range of the operation interface or receiving a selection of other finished music, the music playback suspension area is cancelled.

[0173] For the convenience of description, the above devices are described in terms of functions divided into various modules. Of course, when implementing the embodiments of the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0174] The device of the above embodiment is used to implement the corresponding method 400 in the above embodiment, and has the beneficial effects of the corresponding method 400 embodiment, which will not be described in detail here.

[0175] Based on the same technical concept, corresponding to any of the above-mentioned embodiments and methods, the embodiment of the present disclosure further provides a computer device for implementing the above-mentioned method 400. Figure 6 FIG. 6 is a schematic diagram showing the hardware structure of an exemplary computer device 600 provided in an embodiment of the present disclosure. The computer device 600 can be used to implement Figure 1 In some scenarios, the computer device 600 can also be used to implement Figure 1 Server 104 and database server 106.

[0176] like Figure 6 As shown, the computer device 600 may include: a processor 602, a memory 604, a network module 606, a peripheral interface 608 and a bus 610. The processor 602, the memory 604, the network module 606 and the peripheral interface 608 are connected to each other in communication within the computer device 600 through the bus 610.

[0177] Processor 602 may be a central processing unit (CPU), an image processor, a neural network processor (NPU), a microcontroller (MCU), a programmable logic device, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or one or more integrated circuits. Processor 602 may be used to perform functions related to the technology described in the present disclosure. In some embodiments, processor 602 may also include multiple processors integrated into a single logical component. For example, Figure 6 As shown, processor 602 may include a plurality of processors 602a, 602b, and 602c.

[0178] The memory 604 may be configured to store data (eg, instructions, computer code, etc.). Figure 6 As shown, the data stored in the memory 604 may include program instructions (e.g., program instructions for implementing the method 400 of the embodiment of the present disclosure) and data to be processed (e.g., the memory may store configuration files of other modules, etc.). The processor 602 may also access the program instructions and data stored in the memory 604, and execute the program instructions to operate on the data to be processed. The memory 604 may include a volatile storage device or a non-volatile storage device. In some embodiments, the memory 604 may include a random access memory (RAM), a read-only memory (ROM), an optical disk, a magnetic disk, a hard disk, a solid-state drive (SSD), a flash memory, a memory stick, etc.

[0179] The network interface 606 can be configured to provide the computer device 600 with communication with other external devices via a network. The network can be any wired or wireless network capable of transmitting and receiving data. For example, the network can be a wired network, a local wireless network (e.g., Bluetooth, WiFi, near field communication (NFC)), a cellular network, the Internet, or a combination thereof. It is understood that the type of network is not limited to the above specific examples.

[0180] The peripheral interface 608 can be configured to connect the computer device 600 to one or more peripheral devices to achieve information input and output. For example, the peripheral devices can include input devices such as a keyboard, a mouse, a touch pad, a touch screen, a microphone, and various sensors, and output devices such as a display, a speaker, a vibrator, and an indicator light.

[0181] The bus 610 may be configured to transmit information between various components of the computer device 600 (e.g., the processor 602, the memory 604, the network interface 606, and the peripheral interface 608), such as an internal bus (e.g., a processor-memory bus), an external bus (USB port, PCI-E bus), etc.

[0182] It should be noted that, although the architecture of the above-mentioned computer device 600 only shows the processor 602, the memory 604, the network interface 606, the peripheral interface 608 and the bus 610, in the specific implementation process, the architecture of the computer device 600 may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the architecture of the above-mentioned computer device 600 may also only include the components necessary for implementing the embodiments of the present disclosure, and does not necessarily include all the components shown in the figure.

[0183] The computer device 600 of the above embodiment is used to implement the method 400 described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described in detail here.

[0184] Based on the same technical concept, corresponding to any of the above-mentioned embodiments, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute method 400 described in any of the above embodiments.

[0185] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0186] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the method 400 described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0187] Based on the same technical concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure further provides a computer program product, including computer program instructions, which, when executed on a computer, enable the computer to execute the method 400 described in any of the above-mentioned embodiments. In some embodiments, the computer program instructions may be executed by one or more processors of a computer so that the computer and / or the processor execute the method 400. Corresponding to the execution subject corresponding to each step in each embodiment of the method 400, the processor that executes the corresponding step may belong to the corresponding execution subject.

[0188] The computer program product of the above embodiment is used to enable the computer and / or the processor to execute the method 400 described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described in detail here.

[0189] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Based on the concept of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0190] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present disclosure difficult to understand, the known power / ground connections to the integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present disclosure difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that the embodiments of the present disclosure can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0191] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0192] The embodiments of the present disclosure are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A music generation method, comprising: In response to a music generation operation in the operation interface, a production interface is displayed; the production interface includes at least one music type option; In response to a first operation on any music type option, displaying at least one first category corresponding to any music type option on the production interface; In response to a second operation on any first category, displaying at least one first subcategory corresponding to the any first category, determining a selection of the at least one first subcategory, thereby generating constraint information; In response to the music generation operation, music generation is performed according to the constraint information.

2. The method according to claim 1, wherein: After responding to the first operation on any music type option, the method further includes: Displaying a text area on the production interface; Acquire input text information through the text area; or In response to a third operation being performed in the text area, the text information is automatically generated in the text area.

3. The method according to claim 2, wherein: The generating of music according to the constraint information includes: In response to the existence of the text information, the music generation is performed together with the text information as a constraint.

4. The method according to claim 2, wherein: The step of obtaining the input text information through the text area includes: In response to obtaining a preset structure prompt, displaying prompt information corresponding to the structure prompt; According to a fourth operation on the prompt information or obtaining input information corresponding to the prompt information, a structure word is displayed in the text area, and the input text after the structure word is used as the specific content of the structure word; wherein the structure word corresponds to the specific content of the prompt information determined by the fourth operation, or corresponds to the specific content of the prompt information corresponding to the input information.

5. The method according to claim 1, wherein: The production interface includes a category display area; the display of at least one first subcategory corresponding to any first category includes: According to the second operation, the selected any one of the first categories is determined, and all first subcategories corresponding to the any one of the first categories are displayed in the category display area.

6. The method according to claim 1, wherein: The production interface includes a category display area; the display of at least one first subcategory corresponding to any first category includes: canceling the display of the at least one first category in the category display area, and displaying the at least one first subcategory in the category display area; In response to the selection of any first subcategory, the display of at least one first subcategory is canceled in the category display area, and a second subcategory corresponding to the selected first subcategory is displayed in the category display area, and this cycle is repeated until the number of selected options reaches a preset condition, or a music generation operation is obtained.

7. The method according to claim 1, wherein: The music type options include at least a pure music option; After responding to the first operation on any music type option, the method further includes: In response to the first operation determining that the pure music option is the one, a duration input area is displayed on the production interface so that the music duration can be set through the duration input area.

8. The method according to any one of claims 1 to 7, wherein: The music generation according to the constraint information includes at least one of generating a music song, generating a music song title, and generating a music cover.

9. The method according to claim 1, wherein: After the music is generated according to the constraint information, the method further includes: A first display area for displaying generated music on the production interface; Displaying the content of the constraint information in sequence in the first display area; or At least part of the content of the constraint information and an expansion mark are displayed in the first display area; wherein the expansion mark is used to display the omitted content of the constraint information when triggered.

10. The method according to claim 1, wherein: After the music is generated according to the constraint information, the method further includes: A first display area for displaying generated music on the production interface; A re-editing mark and / or a re-generating mark is added to the first display area.

11. The method according to claim 1, wherein: The operation interface further includes: a second display area for displaying finished music; the second display area includes at least a first area and a second area; In response to a triggering operation on the first area, playing the finished music; In response to a triggering operation on the second area, displaying constraint information corresponding to the finished music and a third area; In response to a triggering operation on the third area, the production interface is displayed, and the production interface is adjusted according to the constraint information corresponding to the finished music.

12. The method according to claim 11, wherein: The operation interface further includes: a music playing suspension area; the music playing suspension area includes at least one of a fourth area, a fifth area and a sixth area; After playing the finished music, the method further includes: In response to the second display area exceeding the display range of the operation interface, displaying the music playback suspension area on the operation interface; In response to a triggering operation on the fourth area, redisplaying the second display area in the display range of the operation interface, and canceling the music playing suspension area; In response to the triggering operation on the fifth area, controlling the playing state of the finished music and / or adjusting the playing attributes; In response to the triggering operation on the sixth area, the music playing suspension area is closed and the playing of the finished music is stopped.

13. The method according to claim 12, wherein: After the music playback suspension area is displayed on the operation interface, the method further includes: In response to the second display area re-entering the display range of the operation interface or receiving a selection of other finished music, the music playback suspension area is cancelled.

14. A music generating device, comprising: The first module is used to display a production interface in response to a music generation operation in the operation interface; the production interface includes at least one music type option; A second module is used for displaying at least one first category corresponding to any music type option on the production interface in response to a first operation on any music type option; A third module is used for, in response to a second operation on any first category, displaying at least one first subcategory corresponding to the any first category, determining a selection of the at least one first subcategory, thereby generating constraint information; The fourth module is used to generate music according to the constraint information in response to the music generation operation.

15. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the method according to any one of claims 1 to 13 is implemented.

16. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 13.

Images