A method and system for processing information of AI music creation

Abstract

The present application provides an AI music creation information processing method and system, in which the user device displays an AI music configuration auxiliary control in the creation center management interface of the target skit; when a mouse hover event for the AI ​​music configuration auxiliary control is detected, a pop-up box displays the function description information of the AI ​​music configuration auxiliary control; when a click event for the AI ​​music configuration auxiliary control is detected, the recommended configuration information for the opening song and the recommended configuration information for the ending song are displayed in the first area of ​​the creation center management interface, and the recommended configuration information for the background music of at least one target storyboard of at least one drama is displayed in the second area of ​​the creation center management interface. Therefore, in the present application, the user only needs to click on the AI ​​music configuration auxiliary control to obtain the recommended configuration information for the opening song, ending song, and background music of the storyboard in the target skit, which can significantly improve the efficiency of skit production and simplify the music configuration process.

Description

Technical Field

[0001] The present application relates to the field of digital film and television development and production technology, and in particular to an AI music creation information processing method and system. Background Art

[0002] At present, it has become a trend to use AIGC technology to achieve human-machine co-creation of video works. The text-generated video and image-generated video functions of some video platforms are already able to create original videos for users, and have provided basic functions such as lip syncing, frame interpolation, and resolution enhancement for the original video materials.

[0003] As a vertical sub-product of video works, the production process of short plays is also being iterated by AIGC technology. For the configuration of background music for short plays, users currently need to load the original video works into professional video editing software and create or select music materials manually to configure them into the original video materials. Summary of the invention

[0004] The present application provides an AI music creation information processing method and system. Users only need to click on the AI ​​music configuration auxiliary control to obtain the recommended configuration information of the opening song, ending song and background music of the target short drama. This can significantly improve the efficiency of short drama production, simplify the music configuration process, lower the technical threshold, and enhance the overall user experience.

[0005] The present application provides an AI music creation information processing method, which is applied to a user device of a short play editing system, wherein the short play editing system includes a server and the user device, and the method includes: displaying an AI music configuration auxiliary control on a creation center management interface of a target short play; detecting a mouse hover event for the AI ​​music configuration auxiliary control, and displaying a pop-up box with functional description information of the AI ​​music configuration auxiliary control; detecting a click event for the AI ​​music configuration auxiliary control, creating a music configuration request message for the target short play, and sending the music configuration request message to the server, wherein the music configuration request message is associated with a music recommendation configuration for the target short play, and the music recommendation configuration includes opening song recommendation configuration information, ending song recommendation configuration information, and background music recommendation configuration information for at least one target storyboard of at least one episode of the target short play; receiving a music configuration response message from the server, displaying the opening song recommendation configuration information and the ending song recommendation configuration information in a first area of ​​the creation center management interface, and displaying the background music recommendation configuration information for at least one target storyboard of the at least one episode in a second area of ​​the creation center management interface.

[0006] In some embodiments, the opening song recommendation configuration information and the ending song recommendation configuration information include at least one of the following description information of the first category of elements: song title, lyrics, theme, genre, and style.

[0007] In some embodiments, the creation process of the opening song recommendation configuration information and the ending song recommendation configuration information includes the following steps: selecting from a short drama database a plurality of existing short dramas of the same type as the target short drama and having a barrage heat index higher than a preset barrage heat index, wherein the barrage heat index refers to the barrage heat value during the opening song playback period and the barrage heat value during the ending song playback period; analyzing a plurality of opening songs of the plurality of existing short dramas to obtain a common feature collection result of the opening songs, wherein the common feature collection result of the opening songs includes feature data of the first category of elements; analyzing a plurality of ending songs of the plurality of existing short dramas to obtain a common feature collection result of the ending songs, wherein the common feature collection result of the ending songs includes feature data of the first category of elements; creating the opening song recommendation configuration information according to the common feature collection result of the opening songs; creating the ending song recommendation configuration information according to the common feature collection result of the ending songs.

[0008] In some embodiments, the opening song recommendation configuration information and the ending song recommendation configuration information also include description information of the following second category elements: reference music material; the reference music material includes the opening song or ending song with the highest barrage heat index in the multiple existing short dramas.

[0009] In some embodiments, the description information of the lyrics includes at least one meta-tag in a meta-tag set that is identical to a reference meta-tag contained in the song structure of the reference music material; the meta-tag refers to a prompt label for different structural parts of the song, and the meta-tag set includes multiple preset meta-tags.

[0010] In some embodiments, the method further includes: detecting a click event on a theme song creation control in the first area of ​​the creation center management interface, displaying a first prompt message in a pop-up box to inquire whether the user wants to create a theme song for the target short drama according to the current theme song recommendation configuration information; and, detecting a confirmation operation on the first prompt message, sending a theme song creation request message carrying the current theme song recommendation configuration information to the server, wherein the theme song creation request message is associated with the theme song of the target short drama; and, receiving a theme song creation response message from the server, and displaying the requested theme song creation response message. the target short drama; or, detecting a click event on the ending song creation control in the first area of ​​the creation center management interface, displaying a second prompt message in a pop-up box to ask the user whether to create a series ending song for the target short drama according to the current ending song recommendation configuration information; and, detecting a confirmation operation for the second prompt message, sending an ending song creation request message carrying the current ending song recommendation configuration information to the server, the ending song creation request message being associated with the series ending song of the target short drama; and, receiving an ending song creation response message from the server, and displaying the series ending song.

[0011] In some embodiments, the background music recommendation configuration information includes pure music recommendation configuration information, wherein the pure music recommendation configuration information includes at least one of the descriptive information of the following elements: song title, theme, genre, style.

[0012] In some embodiments, the background music recommendation configuration information also includes non-pure music recommendation configuration information; the non-pure music recommendation configuration information includes at least one of the following elements of description information: song title, lyrics, theme, genre, style.

[0013] In some embodiments, the background music recommendation configuration information includes pure music recommendation configuration information and / or non-pure music recommendation configuration information, wherein the pure music recommendation configuration information includes created pure music songs; and the non-pure music recommendation configuration information includes created non-pure music songs.

[0014] It can be seen that in the embodiment of the present application, the user device displays the AI ​​music configuration auxiliary control in the creation center management interface of the target short play; detects the mouse hover event for the AI ​​music configuration auxiliary control, and displays the function description information of the AI ​​music configuration auxiliary control in a pop-up box; detects the click event for the AI ​​music configuration auxiliary control, creates a music configuration request message for the target short play, and sends a music configuration request message to the server, the music configuration request message is associated with the music recommendation configuration of the target short play, and the music recommendation configuration includes the opening song recommendation configuration information, the ending song recommendation configuration information, and the background music recommendation configuration information of at least one target storyboard of at least one episode of the target short play; receives the music configuration response message from the server, displays the opening song recommendation configuration information and the ending song recommendation configuration information in the first area of ​​the creation center management interface, and displays the background music recommendation configuration information of at least one target storyboard of at least one episode in the second area of ​​the creation center management interface. Therefore, in the present application, the user only needs to click the AI ​​music configuration auxiliary control to obtain the recommended configuration information of the opening song, the ending song, and the background music of the storyboard in the target short play, which can significantly improve the efficiency of short play production, simplify the music configuration process, reduce the technical threshold, and enhance the overall user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 A schematic diagram of the structure of a skit editing system provided in an embodiment of the present application;

[0017] Figure 2 A schematic diagram of a process flow of a skit editing system provided in an embodiment of the present application;

[0018] Figure 3-Figure 7 A schematic diagram of a creation center management interface for a target skit provided in an embodiment of the present application;

[0019] Figure 8 A schematic diagram of the structure of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0021] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0022] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0023] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist at the same time; B exists alone. Among them, A and B can be singular or plural.

[0024] In the embodiment of the present application, the symbol " / " can indicate that the objects associated with each other are in an "or" relationship. In addition, the symbol " / " can also indicate a division sign, that is, performing a division operation. For example, A / B can indicate A divided by B.

[0025] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0026] In the embodiments of the present application, "equal to" can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. When equal to is used in conjunction with greater than, it is not used in conjunction with less than; when equal to is used in conjunction with less than, it is not used in conjunction with greater than.

[0027] The present application provides an AI music creation information processing method and system. Users only need to click on the AI ​​music configuration auxiliary control to obtain the recommended configuration information of the opening song, ending song and background music of the target short drama. This can significantly improve the efficiency of short drama production, simplify the music configuration process, lower the technical threshold, and enhance the overall user experience.

[0028] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0029] See also Figure 1 and Figure 2 , Figure 1 A schematic diagram of the structure of a skit editing system provided in an embodiment of the present application. Figure 2 A schematic diagram of the processing flow of a skit editing system provided in an embodiment of the present application.

[0030] The skit editing system 1 includes a user device 10 and a server 20. The server 20 is connected to the user device 10 in a wired or wireless communication manner.

[0031] The user equipment 10 may specifically include a front-end device applied to the user side and capable of realizing functions such as data collection and data transmission, and may be a user equipment (UE) such as a mobile phone, a smart phone, a laptop, a digital broadcast receiver, a personal digital assistant (PDA), a tablet computer (PAD), a handheld device, a vehicle-mounted device, a wearable device, a computing device or other processing equipment connected to a wireless modem, a mobile station (MS), a mobile terminal, etc. Alternatively, the user equipment 10 may also be a software application that can be run in the above electronic devices. For example, it may be an APP running on a mobile phone.

[0032] The server 20 may specifically include a server that is applied to one side of the network platform and is responsible for data processing in the background, which can realize functions such as data transmission and data processing. It may be a physical server, or a server cluster or distributed system composed of multiple physical servers. In this embodiment, the number of servers is not specifically limited. Alternatively, it may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0033] The user equipment 10 is Figure 2 The execution body of the AI ​​music creation information processing method shown in the figure includes the following steps S201-S204:

[0034] Step S201: The user device displays the AI ​​music configuration auxiliary control in the creation center management interface of the target skit.

[0035] Step S202: The user device detects a mouse hover event for the AI ​​music configuration auxiliary control, and a pop-up box displays function description information of the AI ​​music configuration auxiliary control.

[0036] Among them, the functional description information of the AI ​​music configuration auxiliary control can be specifically: The AI ​​music configuration auxiliary control is used to generate music recommendation configuration information for the opening song, ending song and background music of the target short drama according to the music configuration information of similar short dramas of the target short drama, for users to refer to in the music composition link. Users can directly generate the opening song, ending song and background music of the drama storyboard according to the music recommendation configuration information.

[0037] Step S203: The user device detects a click event on the AI ​​music configuration auxiliary control, creates a music configuration request message for the target skit, and sends the music configuration request message to the server.

[0038] After the user clicks the AI ​​music configuration auxiliary control, the user device creates a music configuration request message for the target skit according to the click event, and the music configuration request message is associated with the music recommendation configuration of the target skit, and the music recommendation configuration includes the opening song recommendation configuration information, the ending song recommendation configuration information, and the background music recommendation configuration information of at least one target storyboard of at least one episode of the target skit. The user device sends the music configuration request message to the server to instruct the server to generate the music configuration information of the target skit.

[0039] Step S204, the user device receives a music configuration response message from the server, displays the opening song recommendation configuration information and the ending song recommendation configuration information in the first area of ​​the creation center management interface, and displays the background music recommendation configuration information of at least one target storyboard of at least one episode in the second area of ​​the creation center management interface.

[0040] The music configuration response message includes the recommended configuration information of the opening song, the recommended configuration information of the ending song, and the recommended configuration information of the background music of the target short play.

[0041] It can be seen that in the embodiment of the present application, the user device displays the AI ​​music configuration auxiliary control in the creation center management interface of the target short play; detects the mouse hover event for the AI ​​music configuration auxiliary control, and displays the function description information of the AI ​​music configuration auxiliary control in a pop-up box; detects the click event for the AI ​​music configuration auxiliary control, creates a music configuration request message for the target short play, and sends a music configuration request message to the server, the music configuration request message is associated with the music recommendation configuration of the target short play, and the music recommendation configuration includes the opening song recommendation configuration information, the ending song recommendation configuration information, and the background music recommendation configuration information of at least one target storyboard of at least one episode of the target short play; receives the music configuration response message from the server, displays the opening song recommendation configuration information and the ending song recommendation configuration information in the first area of ​​the creation center management interface, and displays the background music recommendation configuration information of at least one target storyboard of at least one episode in the second area of ​​the creation center management interface. Therefore, in the present application, the user only needs to click the AI ​​music configuration auxiliary control to obtain the recommended configuration information of the opening song, the ending song, and the background music of the storyboard in the target short play, which can significantly improve the efficiency of short play production, simplify the music configuration process, reduce the technical threshold, and enhance the overall user experience.

[0042] In some embodiments, the opening song recommendation configuration information and the ending song recommendation configuration information include at least one of the following description information of the first category of elements: song title, lyrics, theme, genre, and style.

[0043] Among them, the description information of the song title includes but is not limited to the use of at least one keyword for description; the description information of the lyrics includes but is not limited to the use of multiple keywords and emotional information for description; the description information of the theme includes but is not limited to the use of at least one keyword for description; the description information of the genre includes but is not limited to the use of at least one genre keyword for description, and common music genres include ancient style, pop, Latin, rock, jazz, country, electronic, metal, etc.; the description information of the style includes but is not limited to the use of at least one style keyword for description, and common music styles include lyrical, simple, electronic, emotional / atmospheric, tough, dark, etc.

[0044] In some embodiments, the process of creating the opening song recommendation configuration information and the ending song recommendation configuration information by the server includes the following steps a-e:

[0045] Step a, selecting from a short drama database a plurality of stock short dramas of the same type as the target short drama and having a barrage heat index higher than a preset barrage heat index, wherein the barrage heat index refers to the barrage heat value during the opening song playing period and the barrage heat value during the ending song playing period;

[0046] Step b, analyzing a plurality of opening songs of the plurality of stock short dramas to obtain a collection result of common characteristics of the opening songs, wherein the collection result of common characteristics of the opening songs includes characteristic data of the first category of elements;

[0047] Step c, analyzing the multiple ending songs of the multiple stock short dramas to obtain a common feature collection result of the ending songs, wherein the common feature collection result of the ending songs includes feature data of the first category of elements;

[0048] Step d, creating the opening song recommendation configuration information according to the common feature collection result of the opening song;

[0049] Step e: creating the ending song recommendation configuration information according to the common feature collection results of the ending songs.

[0050] For step a, first, the type of the target short drama is obtained according to the preset basic attribute parameters of the target short drama. The basic attribute parameters are used to describe the basic information of the short drama. The basic attribute parameters include but are not limited to the type, theme, duration, production method, target audience and other information of the short drama, which are usually set by the user during the short drama upload stage. The types of short dramas include but are not limited to emotional, funny, suspense, urban, family, costume, fantasy, science fiction, martial arts and other types; secondly, short dramas of the same type as the target short drama are selected from the short drama database; thirdly, the barrage heat values ​​of the aforementioned similar short dramas during the opening song playback period and the barrage heat values ​​during the ending song playback period are obtained, and multiple stock short dramas whose barrage heat values ​​exceed the preset barrage heat index are obtained.

[0051] With respect to step b, the specific process of analyzing the multiple opening songs of the multiple stock short dramas to obtain the common feature collection results of the opening songs includes the following steps b1 to b8, wherein the common feature collection results of the opening songs include the feature data of the first category of elements:

[0052] Step b1, obtaining lyrics and opening theme, and extracting a first keyword set and emotional information according to the lyrics;

[0053] Step b2, obtaining the text content of the skit, and extracting a second keyword set, the skit theme, and emotional information based on the text content;

[0054] Step b3, determining a first correlation between the theme of the opening song and the theme of the skit, and determining a first target correlation between the theme of the opening song of the target skit and the theme of the target skit based on the first correlation;

[0055] Step b4, determining a second correlation between the first keyword set and the second keyword set, and determining a second target correlation between the lyrics of the target skit and the keywords of the target skit based on the second correlation; wherein the correlation can be determined based on the overlap rate between the first keyword set and the second keyword set;

[0056] Step b5, determining a third correlation between the song title and the first keyword set, and determining a third target correlation between the song title of the target skit and the lyrics of the target skit based on the third correlation;

[0057] Step b6, determining the correlation between the emotional information of the lyrics and the emotional information of the skit, the correlation includes a positive correlation and a negative correlation, and determining the target correlation between the emotional information of the target skit opening song and the emotional information of the target skit according to the correlation with the highest usage rate; a positive correlation means that the emotional information of the lyrics is consistent with the emotional information of the skit, if the skit is sad, the opening song is sad; if the skit is happy and then sad, the opening song is happy and then sad; a negative correlation means that the emotional information of the lyrics is opposite to the emotional information of the skit, if the skit is sad, the opening song is happy;

[0058] Step b7, obtaining the genre and style of the opening song, and determining the genre and style with the highest usage rate as the target genre and target style of the opening song of the target skit;

[0059] Step b8, determining the common feature clustering results of the opening song includes the first target correlation between the opening song theme of the target short play and the theme of the target short play, the second target correlation between the lyrics of the target short play and the keywords of the target short play, the third target correlation between the song title of the target short play and the lyrics of the target short play, the target correlation relationship between the emotional information of the opening song of the target short play and the emotional information of the target short play, the target genre and the target style.

[0060] With respect to step c, the specific process of analyzing the multiple ending songs of the multiple stock short dramas to obtain the common feature collection results of the ending songs includes the following steps c1 to c8, wherein the common feature collection results of the ending songs include feature data of the first category of elements:

[0061] Step c1, obtaining lyrics and ending theme, and extracting a third keyword set and emotional information based on the lyrics;

[0062] Step c2, obtaining the text content of the skit, and extracting a fourth keyword set, the theme of the skit, and emotional information according to the text content;

[0063] Step c3, determining a fourth correlation between the ending theme and the skit theme, and determining a fourth target correlation between the ending theme of the target skit and the target skit theme based on the fourth correlation;

[0064] Step c4, determining a fifth correlation between the third keyword set and the fourth keyword set, and determining a fifth target correlation between the lyrics of the target skit and the keywords of the target skit according to the fifth correlation; wherein the correlation can be determined according to the overlap rate between the third keyword set and the fourth keyword set;

[0065] Step c5, determining a sixth correlation between the song title and the third keyword set, and determining a sixth target correlation between the song title of the target skit and the lyrics of the target skit based on the sixth correlation;

[0066] Step c6, determining the correlation between the emotional information of the lyrics and the emotional information of the skit, the correlation includes a positive correlation and a negative correlation, and determining the target correlation between the emotional information of the target skit ending song and the emotional information of the target skit according to the correlation with the highest usage rate; a positive correlation means that the emotional information of the lyrics is consistent with the emotional information of the skit, if the skit is sad, the ending song is sad; if the skit is happy and then sad, the ending song is happy and then sad; a negative correlation means that the emotional information of the lyrics is opposite to the emotional information of the skit, if the skit is sad, the ending song is happy;

[0067] Step c7, obtaining the genre and style of the ending song, and determining the genre and style with the highest usage rate as the target genre and target style of the ending song of the target skit;

[0068] Step c8, determining the common feature clustering results of the ending song includes the fourth target correlation between the ending song theme of the target short play and the target short play theme, the fifth target correlation between the lyrics of the target short play and the keywords of the target short play, the sixth target correlation between the song title of the target short play and the lyrics of the target short play, the target correlation relationship between the emotional information of the target short play ending song and the emotional information of the target short play, the target genre and the target style.

[0069] For step d, the specific process of creating the opening song recommendation configuration information based on the common feature collection results of the opening song includes: determining the opening song theme based on the first target relevance and the target short play theme; determining the keyword set of the opening song lyrics based on the second target relevance and the keyword set of the target short play; determining the keywords of the song title based on the third target relevance and the keyword set of the lyrics; determining the emotional information of the opening song based on the emotional information of the target short play and the target association relationship; determining the genre and style of the opening song based on the target genre and target style.

[0070] Exemplarily, if the first target correlation is 1, the theme of the target skit is used as the theme of the opening song; if the second target correlation is 0.4, the keywords of the lyrics of the opening song are selected from the top 40% of the keywords in the keyword set of the target skit; if the third target correlation is 0.1, the keywords of the song title are selected from the top 10% of the keywords in the lyrics; if the most used correlation is a positive correlation, the target correlation is a positive correlation; if the most used genres and styles are electronic music and electronic pop, the target genre is electronic music and the target style is electronic pop.

[0071] For step e, the process of creating the ending song recommendation configuration information based on the common feature collection results of the ending song specifically includes: determining the ending song theme based on the third target relevance and the target short play theme; determining the keyword set of the lyrics of the ending song based on the fourth target relevance and the keyword set of the target short play; determining the keywords of the song title based on the fifth target relevance and the keyword set of the lyrics; determining the emotional information of the ending song based on the emotional information of the target short play and the target association relationship; determining the genre and style of the ending song based on the target genre and target style.

[0072] It can be seen that in the embodiment, the common features between the text content of the short drama and the opening song and ending song of the short drama are determined from similar short dramas that are similar to the target short drama and have higher barrage heat values. According to the common features, the recommended configuration information of the opening song and ending song of the target short drama is generated in combination with the target short drama. This ensures that the opening and ending music of the target short drama are consistent with the emotional needs and expectations of the audience while being related to the plot, thereby improving the recognizability of the short drama and enhancing the audience's sense of resonance.

[0073] In some embodiments, the opening song recommendation configuration information and the ending song recommendation configuration information also include description information of the following second category elements: reference music material; the reference music material includes the opening song or ending song with the highest barrage heat index in the multiple existing short dramas.

[0074] In some embodiments, the description information of the lyrics includes at least one meta-tag in a meta-tag set that is identical to a reference meta-tag contained in the song structure of the reference music material; the meta-tag refers to a prompt label for different structural parts of the song, and the meta-tag set includes multiple preset meta-tags.

[0075] Among them, meta tags refer to the prompt labels of different structural parts of lyrics, which can guide the generation of lyrics according to the prompt labels. Meta tags can be used to describe specific parts of the prompted lyrics, or to affect the entire prompt by describing speaker characteristics or music genres.

[0076] The description information of the lyrics also includes at least one meta tag, and the at least one meta tag may include one or more of the reference meta tags contained in the reference music material.

[0077] The meta tag set includes at least a plurality of meta tags as shown in the following Table 1:

[0078] Table 1 Meta tag names and detailed description

[0079]

[0080] It can be seen that in this embodiment, by adding meta tags in the lyrics, the song structure and rhythm of the opening song or the ending song can be better controlled. At the same time, referring to the reference meta tags of the reference music material with the highest barrage heat index can make the music rhythm conform to the public experience and more easily attract the audience.

[0081] In some embodiments, the background music recommendation configuration information includes pure music recommendation configuration information, wherein the pure music recommendation configuration information includes at least one of the descriptive information of the following elements: song title, theme, genre, style.

[0082] In some embodiments, the background music recommendation configuration information also includes non-pure music recommendation configuration information; the non-pure music recommendation configuration information includes at least one of the following elements of description information: song title, lyrics, theme, genre, style.

[0083] In the above two embodiments, the server generates background music recommendation configuration information according to the plot content of each target storyboard of the target skit. The background music recommendation configuration information mainly includes description information about at least one of the song title, lyrics, theme, genre, and style.

[0084] In some embodiments, the background music recommendation configuration information includes pure music recommendation configuration information and / or non-pure music recommendation configuration information, wherein the pure music recommendation configuration information includes created pure music songs; and the non-pure music recommendation configuration information includes created non-pure music songs.

[0085] In this embodiment, the server generates background music recommendation configuration information based on the plot content of the currently processed target storyboard of the target skit. When the background music recommendation configuration information is the same as the background music recommendation configuration information of the previously processed storyboard, the server can also directly display pure music songs or non-pure music songs generated according to the background music recommendation configuration information.

[0086] The specific process of the server determining the background music recommendation configuration information of the storyboard video clip according to the plot content of the target skit includes the following steps f1 to f3:

[0087] Step f1, obtaining multiple storyboard video clips included in the target skit;

[0088] Step f2, obtaining the plot content of each storyboard video clip in the plurality of storyboard video clips, wherein the plot content is composed of key feature elements, and the key feature elements include scenes, roles, emotions, events, etc.;

[0089] Step f3: label each storyboard video clip with recommended configuration information according to the plot content.

[0090] With respect to step f3, the specific process of labeling each storyboard video clip with recommended configuration information according to the plot content includes the following steps f301 to f302:

[0091] Step f301, for the soundtrack in a single episode, if the single episode only includes one target storyboard, annotate the recommended pure music recommendation configuration information or non-pure music recommendation configuration information according to the key feature elements;

[0092] If a single episode includes multiple target storyboards, obtain the correlation relationship between the plot contents of the multiple target storyboards, and annotate the pure music recommendation configuration information or non-pure music recommendation configuration information of each target storyboard according to the correlation relationship;

[0093] Step f302, for the soundtracks of adjacent episodes, add a note of the background music recommendation configuration information of the last storyboard video clip of the previous episode to the first storyboard video clip of each episode, to ensure that the music of the same plot in adjacent episodes remains consistent.

[0094] Wherein, for step f301, if a single drama includes only one target storyboard, the specific process of marking the recommended pure music recommendation configuration information or non-pure music recommendation configuration information according to the key feature elements includes:

[0095] If the background music recommendation configuration information is pure music recommendation configuration information, the song title and theme description information are determined according to the scenes and events of the plot content; the genre and style description information are determined according to the scenes, characters, and emotions.

[0096] If the background music recommendation configuration information is not pure music recommendation configuration information, the descriptive information of the song title and theme is determined according to the scenes and events of the plot content; the descriptive information of the genre and style is determined according to the scenes, characters, and emotions; and the descriptive information of the lyrics is determined according to the scenes, events, and emotions.

[0097] For example, the plot content of a target storyboard includes {scene: an abandoned factory late at night; character: a detective looking for clues alone; emotion: tension, mystery; event: the detective tracked the suspect, discovered the suspect's secret, and photographed the key evidence}, then the descriptive information of the song title can be tracking, secret, etc.; the descriptive information of the theme can be suspense, crime; for non-pure music, the descriptive information of the lyrics can be exploration, secret or justice, evidence-related, such as finding the truth, etc.; the descriptive information of the genre can be electronic, ambient music; the descriptive information of the style can be mysterious, gloomy sound effects.

[0098] Among them, for step f301, if a single drama includes multiple target storyboards, the specific process of obtaining the correlation relationship of the plot contents of the multiple target storyboards and marking the recommended pure music recommendation configuration information or non-pure music recommendation configuration information of each target storyboard according to the correlation relationship includes:

[0099] Get the recommended background music configuration information for the first target storyboard in a single episode;

[0100] The recommended configuration information of the background music of the first target storyboard is adjusted according to the association relationship to obtain the recommended configuration information of the background music of the subsequent target storyboards.

[0101] Among them, the correlation between storyboards usually includes: continuation relationship, fragment A naturally transitions to fragment B, continuing the storyline or dialogue; advancement relationship, fragment A further promotes the development of the story or introduces a new plot into fragment B; turning point relationship, fragment A and fragment B have significant changes in plot and emotion; contrast relationship, fragment A and fragment B contrast different situations, roles or emotional states; cause and effect relationship, the events in fragment A directly lead to the results in fragment B.

[0102] In specific implementation, if the previous frame of two adjacent frames in multiple target frames is fragment A, and the next frame is fragment B, for the connection relationship, the background music of fragment B can be consistent with the background music of fragment A; for the advancement relationship and causal relationship, the emotional intensity of the background music of fragment A can be adjusted according to the emotional intensity of fragment B to obtain the recommended background music configuration information of fragment B; for the transition relationship and contrast relationship, the music style of the background music of fragment A can be adjusted to obtain the recommended background music configuration information of fragment B, so as to generate different music and highlight the changes in the plot.

[0103] It can be seen that through the method steps corresponding to step f301, the background music recommendation configuration information of a single target storyboard can be obtained according to the plot content of the single target storyboard, and the background music recommendation configuration information of each target storyboard can be determined according to the association between multiple target storyboards and the background music recommendation configuration information of the first target storyboard, which can ensure the consistency of music for the same or similar plots in the same episode, and at the same time ensure that the music of the storyboard video clips with plot turns in the same episode is different from that of other storyboard video clips to highlight the plot changes. Through the method steps corresponding to step f302, the background music recommendation description information of the last storyboard video clip of the previous episode is added to the first storyboard video clip of each episode, ensuring that the music style of adjacent episodes is consistent and that the overall style of the short play is consistent.

[0104] In some embodiments, the method further includes: detecting a click event on a theme song creation control in the first area of ​​the creation center management interface, displaying a first prompt message in a pop-up box to inquire whether the user wants to create a theme song for the target short drama according to the current theme song recommendation configuration information; and, detecting a confirmation operation on the first prompt message, sending a theme song creation request message carrying the current theme song recommendation configuration information to the server, wherein the theme song creation request message is associated with the theme song of the target short drama; and, receiving a theme song creation response message from the server, and displaying the requested theme song creation response message. the target short drama; or, detecting a click event on the ending song creation control in the first area of ​​the creation center management interface, displaying a second prompt message in a pop-up box to ask the user whether to create a series ending song for the target short drama according to the current ending song recommendation configuration information; and, detecting a confirmation operation for the second prompt message, sending an ending song creation request message carrying the current ending song recommendation configuration information to the server, the ending song creation request message being associated with the series ending song of the target short drama; and, receiving an ending song creation response message from the server, and displaying the series ending song.

[0105] Among them, after the user device displays the recommended configuration information of the opening song in the first area, the user clicks on the opening song creation control; the user device detects the click event on the opening song creation control, and displays the first prompt information through a pop-up box, asking the user whether to generate the series opening song according to the current recommended configuration information of the opening song; the user clicks the confirmation control, and the user device sends an opening song creation request carrying the recommended configuration information of the opening song to the server; the server generates the series opening song according to the description information of at least one element of the song title, lyrics, theme, genre, and style contained in the opening song creation request, and sends the series opening song to the user device; the user device displays the series opening song, and the user can click on the series opening song to preview the short drama soundtrack effect in the preview area.

[0106] Among them, the process of generating the ending song of the series is the same as the steps of the opening song. You can refer to the above specific steps and will not repeat them here.

[0107] It can be seen that in this embodiment, the server can directly generate the corresponding drama opening song or drama ending song according to the recommended configuration information of the automatically generated opening song or ending song, which can improve the efficiency of short drama production, lower the threshold for music composition, and improve the creator's operating experience.

[0108] In some embodiments, a click event of the background music creation control in the second area of ​​the creation center management interface is detected, and a third prompt message is displayed in a pop-up box to ask the user whether to create episode background music for at least one target storyboard of at least one episode of the target short drama according to the current background music recommendation configuration information; and, a confirmation operation for the third prompt message is detected, and a background music creation request message carrying the current background music recommendation configuration information is sent to the server, and the background music creation request message is associated with the episode background music of the target short drama; and, a theme song creation response message is received from the server, and the episode background music is displayed.

[0109] It can be seen that in this embodiment, the server can directly generate corresponding background music based on the recommended configuration information of the automatically generated storyboard video clips, which can reduce the tedious process of users manually configuring the background music of the short drama series, improve the efficiency of short drama production, and further improve the creator's operating experience.

[0110] See also Figure 3-Figure 7 , Figure 3-Figure 7 A schematic diagram of a creation center management interface for a target skit provided in an embodiment of the present application.

[0111] See also Figure 3 After the user uploads the target skit, the skit preview area 31, the music setting area 32, and the episode display area 33 are displayed on the creation center management interface 3 of the skit editing system;

[0112] The preview area 31 is used to display the target skit and the AI ​​music configuration auxiliary control (shown as AI music in the figure); the music setting area 32 is used to set the parameters of the opening music, the ending music, and the storyboard video clip music; the episode display song is used to display the target skit file and the number of episodes of the skit included in the target skit. In addition, the preview area 31 is also used to display the user name, upload time, detailed information of the skit, etc.

[0113] When performing music composition operations, users can choose manual settings or AI automatic settings.

[0114] Manual setting refers to Figure 3 , users can click any of the three controls in the music settings: opening music, ending music, and storyboard video clip music to manually set specific elements. Figure 4 , the elements include at least one descriptive information of the song title, lyrics, theme, genre, style, etc. For the descriptive information of the lyrics, in addition to entering keywords, you can also enter specific meta tags to guide the lyrics structure of the generated soundtrack and the location of the keywords in the lyrics structure. Users can also upload expected reference music materials to guide the system to generate similar soundtracks. After the above information is set, click the creation control to generate the theme song of the series and display it in the soundtrack generation area 35, see Figure 5 . Wherein, the generation of pure music or non-pure music is indicated by a pure music control.

[0115] Among them, AI automatic setting refers to, see Figure 6 , when the user configures auxiliary controls in AI Music ( Figure 6 When you hover over the control (displayed as “AI Music Configuration” in the figure), a pop-up box displays the function description information of the AI ​​Music Configuration auxiliary control 34; after the user clicks the AI ​​Music Configuration control, the music setting area 32 displays the recommended configuration information of the opening song, the recommended configuration information of the ending area, and the recommended configuration information of the background music. Click any of the recommended configuration information to display the following information: Figure 7 The first element shown in the figure includes description information of any one of the song title, lyrics, theme, genre, and style, wherein the description information of the lyrics also includes meta tag information of the lyrics structure, such as Figure 7 [Main Song], [Chorus], etc.; recommended configuration information also includes Figure 7 The second element shown is the reference music material. The reference music material refers to the opening song or ending song of the same type as the target skit and whose barrage heat index exceeds the preset number. Figure 7 The middle one is the theme song. The user clicks the theme song creation control ( Figure 7 The first prompt message is used to ask the user whether to create a theme song for the target short drama according to the current theme song recommended configuration information. After the user clicks the OK control, the server generates the theme song for the drama and displays it in the soundtrack generation area 35.

[0116] Among them, the generation process of the ending song is the same as that of the opening song, so I will not go into details here.

[0117] For the generation process of background music for storyboard video clips, see Figure 3 In the example, the user needs to select a specific episode (e.g., the first episode) to be configured in the episode display area 33, and the server obtains at least one storyboard video clip (e.g., Figure 3Mirror 1, Mirror 2, Mirror 3), execute the following steps for mirror 1, mirror 2, and mirror 3 respectively. Figure 4 Follow the configuration steps in to generate the corresponding background music.

[0118] When AI is set automatically, after the user clicks the AI ​​music control, the server automatically selects all the scenes that need music in all episodes of the target short drama, such as Figure 6 In the storyboard 1 to storyboard n, the user can view the specific recommended configuration information of each storyboard after clicking the background music recommended configuration information. Figure 7 The recommended configuration information for the opening theme is similar, and the specific operation may be: after the user selects at least one storyboard in the episode display area 33, the corresponding configuration information may be displayed in the music setting area 32. After clicking the creation control, the corresponding episode background music may be generated for the configuration information of the at least one selected storyboard; after the user selects all the storyboards in the episode display area 33, he / she may click the creation control to generate the corresponding episode background music for the configuration information of all the storyboards.

[0119] It should be noted that the specific implementation process of this embodiment can refer to the specific implementation process described in the above method embodiment, which will not be described here.

[0120] With the above Figure 2 For details on the embodiments shown in the drawings, please refer to Figure 8 , Figure 8 A schematic diagram of the structure of a server provided in an embodiment of the present application, such as Figure 8 As shown, the server 20 includes a processor 81, a memory 83, a communication interface 82, and one or more programs 831. The one or more programs 831 are stored in the memory 83 and are configured to be executed by the processor 81. The programs include methods for executing the methods described in the above embodiments.

[0121] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method described in the above method embodiments, and the above computer includes an electronic device.

[0122] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0123] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0124] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0125] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0126] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0127] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the above-mentioned methods in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0128] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable memory, which may include a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0129] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An AI music creation information processing method, characterized in that: A user device applied to a skit editing system, the skit editing system comprising a server and the user device, the method comprising: Display AI music configuration auxiliary controls in the target skit creation center management interface; A mouse hover event for the AI ​​music configuration auxiliary control is detected, and a pop-up box displays function description information of the AI ​​music configuration auxiliary control; A click event for the AI ​​music configuration auxiliary control is detected, a music configuration request message for the target skit is created, and the music configuration request message is sent to the server, wherein the music configuration request message is associated with a music recommendation configuration for the target skit, and the music recommendation configuration includes opening song recommendation configuration information, ending song recommendation configuration information, and background music recommendation configuration information for at least one target storyboard of at least one episode of the target skit; wherein the opening song recommendation configuration information and the ending song recommendation configuration information include at least one of the following first-category description information of elements: song title, lyrics, theme, genre, and style; After receiving the music configuration request message, the server selects from the short drama database a plurality of stock short dramas of the same type as the target short drama and having a barrage heat index higher than a preset barrage heat index, wherein the barrage heat index refers to the barrage heat value during the opening song playback period and the barrage heat value during the ending song playback period; Analyze the multiple opening songs of the multiple existing short plays, obtain the opening lyrics and opening song themes of the multiple opening songs, and obtain a first keyword set and opening emotional information according to the opening lyrics; and obtain the text content of the multiple existing short plays, and obtain a second keyword set, short play emotional information and short play themes according to the text content; and determine a first correlation between the opening song theme and the short play theme, and determine a first target correlation between the opening song theme of the target short play and the short play theme of the target short play according to the first correlation; and determine a second correlation between the first keyword set and the second keyword set, and determine a second target correlation between the opening lyrics of the target short play and the second keyword set of the target short play according to the second correlation; and obtain the opening song titles of the multiple opening songs, and determine a first correlation between the opening song title and the first keyword set Three correlations, determining the third target correlation between the title of the opening song of the target skit and the opening lyrics of the target skit according to the third correlation; and determining the correlation between the opening emotional information and the skit emotional information, the correlation including a positive correlation and a negative correlation; determining the correlation with the highest usage rate among the multiple stock skits as the target correlation between the opening emotional information of the target skit and the skit emotional information of the target skit; and obtaining the opening genres and opening styles of the multiple opening songs, determining the opening genres and opening styles with the highest usage rate among the multiple opening songs as the target genre and target style of the opening song of the target skit; and generating the common feature collection results of the opening songs according to the first target correlation, the second target correlation, the third target correlation, the target correlation, the target genre and the target style; Analyze multiple ending songs of the multiple existing short dramas to obtain a common feature collection result of the ending songs, wherein the common feature collection result of the ending songs includes feature data of the first type of elements; Creating the opening song recommendation configuration information according to the common feature collection result of the opening song; Creating the ending song recommendation configuration information according to the ending song common feature collection result; At least one storyboard video clip of at least one episode included in the target short play is obtained; and, the plot content of each storyboard video clip is obtained, the plot content is composed of key feature elements, and the key feature elements include at least one of scenes, characters, emotions and events; and, for the soundtrack in a single episode, if the single episode only includes one target storyboard, the recommended background music recommendation configuration information is annotated according to the key feature elements of the target storyboard; if the single episode includes multiple target storyboards, the association relationship of the plot contents of the multiple target storyboards is obtained, and the background music recommendation configuration information of each target storyboard is annotated according to the association relationship of the plot contents; for the soundtrack of adjacent episodes, the annotation of the background music recommendation configuration information of the last storyboard video clip of the previous episode is added to the first storyboard video clip of each episode, so that the music of the same plot in the adjacent episodes remains consistent; Receive a music configuration response message from the server, display the opening song recommendation configuration information and the ending song recommendation configuration information in the first area of ​​the creation center management interface, and display the background music recommendation configuration information of at least one target storyboard of at least one episode in the second area of ​​the creation center management interface.

2. The method according to claim 1, characterized in that: The opening song recommendation configuration information and the ending song recommendation configuration information also include description information of the following second-category elements: reference music material; The reference music material includes the opening song or the ending song with the highest barrage heat index among the multiple stock short dramas.

3. The method according to claim 2, characterized in that The description information of the lyrics includes at least one meta tag in a meta tag set that is the same as a reference meta tag included in a song structure of the reference music material; The meta tags refer to prompt labels of different structural parts of a song, and the meta tag set includes a plurality of preset meta tags.

4. The method according to claim 3, characterized in that The method further comprises: Detecting a click event on the opening song creation control in the first area of ​​the creation center management interface, a pop-up box displays a first prompt message to ask the user whether to create an opening song for the target short drama according to the current opening song recommendation configuration information; and, detecting a confirmation operation on the first prompt message, sending an opening song creation request message carrying the current opening song recommendation configuration information to the server, the opening song creation request message being associated with the series opening song of the target short drama; and, receiving an opening song creation response message from the server, and displaying the series opening song; or, A click event of the ending song creation control in the first area of ​​the creation center management interface is detected, and a second prompt message is displayed in a pop-up box to ask the user whether to create a series ending song for the target short drama according to the current ending song recommendation configuration information; and, a confirmation operation for the second prompt message is detected, and an ending song creation request message carrying the current ending song recommendation configuration information is sent to the server, and the ending song creation request message is associated with the series ending song of the target short drama; and, an ending song creation response message is received from the server, and the series ending song is displayed.

5. The method according to any one of claims 1 to 3, characterized in that: The background music recommendation configuration information includes pure music recommendation configuration information, wherein the pure music recommendation configuration information includes at least one of the following elements of description information: song title, theme, genre, and style.

6. The method according to claim 5, characterized in that The background music recommendation configuration information also includes non-pure music recommendation configuration information; the non-pure music recommendation configuration information includes at least one of the following elements of description information: song title, lyrics, theme, genre, style.

7. The method according to any one of claims 1 to 3, characterized in that: The background music recommendation configuration information includes pure music recommendation configuration information and / or non-pure music recommendation configuration information, wherein the pure music recommendation configuration information includes created pure music songs; and the non-pure music recommendation configuration information includes created non-pure music songs.

8. An AI music creation information processing system, characterized in that: Includes a server and a user device, wherein: The user equipment is used to perform the steps in the method according to any one of claims 1 to 7.

Images