Somatosensory dance game method for customizing dance video

Abstract

The invention discloses a somatosensory dance game method and device for a user-defined dance video and a computer readable storage medium. The method comprises the steps that keywords input by a user and used for the user-defined dance video are obtained; determining the dance level of the user; generating an accompaniment demand according to the keyword and the dance level; according to the accompaniment demand, generating an accompaniment meeting the accompaniment demand through a preset music model; according to the dance level, screening an adaptive initial dance action from a preset dance action library; according to the accompaniment and the initial dance movement, generating a dance movement sequence matched with the accompaniment; generating a lyric demand according to the accompaniment and the keyword; according to the lyric demand, generating lyrics meeting the lyric demand through a preset natural language model; and combining the accompaniment, the dance action sequence and the lyrics to generate a self-defined dance video. The method has the advantages of being capable of meeting personalized requirements of users and improving game experience of the users.

Description

Technical Field

[0001] The present invention relates to the technical field of somatosensory dance games, and in particular to a somatosensory dance game method, device and computer-readable storage medium for customizing dance videos. Background Art

[0002] With the rapid development of technology, motion-sensing dance games have become one of the important ways for people to relax and have fun. Such games usually use motion-sensing devices, such as motion capture cameras and motion-sensing controllers, to allow users to interact with the game through body movements. Players can follow the instructions on the screen and imitate the preset dance moves, achieving the dual purpose of entertainment and exercise.

[0003] However, existing somatosensory dance games mainly rely on preset songs and dance moves. Game developers design a fixed list of songs and corresponding dance choreography in advance, and players can only choose from these preset contents. Since the song content is pre-set, users cannot customize the game content according to their personal preferences, their own level or specific occasions. This lack of personalized design limits the appeal of the game and reduces the enthusiasm of users to participate. In addition, the fixed nature of the game content may make players feel bored after multiple experiences. This limitation not only affects the user experience, but also limits the market expansion of the game.

[0004] Therefore, it is urgent to provide a kind of dance game to meet the personalized needs of users. Summary of the invention

[0005] The embodiment of the present application aims to meet the personalized needs of users and enhance the user's gaming experience by providing a somatosensory dance game method for customizing dance videos.

[0006] To achieve the above-mentioned purpose, the embodiment of the present application provides a somatosensory dance game method for customizing dance videos, comprising: obtaining keywords input by a user for customizing dance videos;

[0007] Confirm the user's dancing level;

[0008] Generate accompaniment requirements according to the keywords and the dance level;

[0009] According to the accompaniment requirement, generating an accompaniment that meets the accompaniment requirement through a preset music model;

[0010] According to the dance level, selecting appropriate initial dance movements from a preset dance movement library;

[0011] Generating a dance movement sequence matching the accompaniment according to the accompaniment and the initial dance movement;

[0012] Generate lyrics requirements according to the accompaniment and the keywords;

[0013] According to the lyrics requirement, lyrics that meet the lyrics requirement are generated through a preset natural language model;

[0014] The accompaniment, dance action sequence and lyrics are combined to generate a customized dance video.

[0015] To achieve the above-mentioned objectives, an embodiment of the present application also proposes a somatosensory dance game device for custom dance videos, comprising a memory, a processor, and a somatosensory dance game program for custom dance videos stored in the memory and executable on the processor, wherein the processor implements a somatosensory dance game method for custom dance videos as described in any one of the above items when executing the somatosensory dance game program for custom dance videos.

[0016] To achieve the above objectives, an embodiment of the present application also proposes a computer-readable storage medium, on which a somatosensory dance game program for a custom dance video is stored. When the somatosensory dance game program for a custom dance video is executed by a processor, a somatosensory dance game method for a custom dance video as described in any of the above items is implemented.

[0017] The somatosensory dance game method of the present application obtains the keywords input by the user and generates the corresponding accompaniment requirements and lyrics requirements in combination with the user's dance level, so that a customized dance video can be realized according to the user's personalized needs, thereby enhancing the user's personalized interactive experience. Among them, since the accompaniment requirements are determined based on the user's dance level and the input keywords, this not only enables the generated accompaniment to match the user's emotional expression, but also ensures that the rhythm and complexity of the accompaniment adapt to the user's dance ability, thereby enhancing the coordination and consistency of music and dance.

[0018] In addition, the lyrics requirements are generated based on the accompaniment structure and the keywords input by the user, so as to ensure that the generated lyrics can express the user's emotional needs and are consistent with the accompaniment in structure and emotion. In this way, the generated dance songs not only have a high level of musical and dance expressiveness, but also form a perfect unity between the lyrics content and the music style.

[0019] Moreover, since the dance movement sequence is generated by matching the music structure of the accompaniment with the user's dance level, the fluency and synchronization of the dance movements with the music are further improved, thereby enhancing the user's immersion and overall experience.

[0020] Therefore, compared with traditional somatosensory dance games, the somatosensory dance game method of the present application can achieve a higher degree of personalized customization and ensure a high degree of unity in rhythm, emotion and structure among music, lyrics and dance movements, thereby greatly improving user participation and satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0022] Figure 1 A module structure diagram of an embodiment of a somatosensory dance game device for customizing dance videos according to the present invention;

[0023] Figure 2 The figure is a flow chart of an embodiment of a somatosensory dance game method for customizing dance videos according to the present invention. DETAILED DESCRIPTION

[0024] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0025] In order to better understand the above technical solution, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0026] It should be noted that in the claims, any reference symbols placed between brackets shall not be constructed as limitations to the claims. The presence of "comprising" in the text does not exclude the presence of components or steps not listed in the claims. The quantifier "one" or "an" preceding a component does not exclude the presence of a plurality of such components. The present invention can be implemented by means of hardware comprising several different components and by means of appropriately programmed computers. In a unit claim that lists several means, several of these means may be embodied by the same hardware item. The use of "first", "second", and "third" etc. does not indicate any order, and these words may be interpreted as names.

[0027] like Figure 1 As shown, Figure 1It is a schematic diagram of the structure of a server 1 (also called a somatosensory dance game device for custom dance videos) in the hardware operating environment involved in the embodiment of the present invention.

[0028] The server of the embodiment of the present invention is a device with display function, such as "Internet of Things devices", smart air conditioners, smart lights, smart power supplies with networking functions, AR / VR devices with networking functions, smart speakers, self-driving cars, PCs, smart phones, tablet computers, e-book readers, portable computers, etc.

[0029] like Figure 1 As shown, the server 1 includes: a memory 11, a processor 12 and a network interface 13.

[0030] The memory 11 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 11 may be an internal storage unit of the server 1, such as a hard disk of the server 1. In other embodiments, the memory 11 may also be an external storage device of the server 1, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card, etc., equipped on the server 1.

[0031] Furthermore, the memory 11 may include an internal storage unit of the server 1 as well as an external storage device. The memory 11 may be used not only to store application software and various data installed on the server 1, such as the code of the somatosensory dance game program 10 of the custom dance video, but also to temporarily store data that has been output or is to be output.

[0032] In some embodiments, the processor 12 can be a central processing unit (CPU), a controller, a microcontroller, a microprocessor or other data processing chip, which is used to run the program code or process data stored in the memory 11, such as executing the somatosensory dance game program 10 of the custom dance video.

[0033] The network interface 13 may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and is generally used to establish a communication connection between the server 1 and other electronic devices.

[0034] The network may be the Internet, a cloud network, a wireless fidelity (Wi-Fi) network, a personal area network (PAN), a local area network (LAN), and / or a metropolitan area network (MAN). Various devices in the network environment may be configured to connect to the communication network according to various wired and wireless communication protocols. Examples of such wired and wireless communication protocols may include, but are not limited to, at least one of the following: Transmission Control Protocol and Internet Protocol (TCP / IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), ZigBee, EDGE, IEEE 802.11, Light Fidelity (Li-Fi), 802.16, IEEE 802.11s, IEEE 802.11g, multi-hop communication, wireless access point (AP), device-to-device communication, cellular communication protocol, and / or Bluetooth (Blue Tooth) communication protocol or a combination thereof.

[0035] Optionally, the server may further include a user interface, which may include a display, an input unit such as a keyboard, and an optional user interface may further include a standard wired interface and a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode) touch device, etc. The display may also be referred to as a display screen or a display unit, which is used to display information processed in the server 1 and to display a visual user interface.

[0036] Figure 1 Only the server 1 having components 11-13 and a somatosensory dance game program 10 of a custom dance video is shown. It can be understood by those skilled in the art that Figure 1 The structure shown does not constitute a limitation on the server 1, and may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.

[0037] In this embodiment, the processor 12 can be used to call the somatosensory dance game program of the custom dance video stored in the memory 11, and perform the following operations:

[0038] Get the keywords entered by the user for customizing the dance video;

[0039] Confirm the user's dancing level;

[0040] Generate accompaniment requirements according to the keywords and the dance level;

[0041] According to the accompaniment requirement, generating an accompaniment that meets the accompaniment requirement through a preset music model;

[0042] According to the dance level, selecting appropriate initial dance movements from a preset dance movement library;

[0043] Generating a dance movement sequence matching the accompaniment according to the accompaniment and the initial dance movement;

[0044] Generate lyrics requirements according to the accompaniment and the keywords;

[0045] According to the lyrics requirement, lyrics that meet the lyrics requirement are generated through a preset natural language model;

[0046] The accompaniment, dance action sequence and lyrics are combined to generate a customized dance video.

[0047] Based on the hardware architecture of the above-mentioned somatosensory dance game device for customized dance videos, an embodiment of a somatosensory dance game method for customized dance videos of the present invention is proposed. The somatosensory dance game method for customized dance videos of the present invention is intended to meet the personalized needs of users and enhance the user's gaming experience.

[0048] Reference Figure 2 , Figure 2 This is an embodiment of a somatosensory dance game method for a custom dance video of the present invention, and the somatosensory dance game method for a custom dance video comprises the following steps:

[0049] S10: Obtain keywords input by the user for customizing the dance video.

[0050] Among these, keywords refer to words entered by users based on personal preferences, emotions or themes, such as emotional keywords (such as "happy", "sad"), thematic keywords (such as "dream", "freedom"), etc.

[0051] Specifically, the system accepts keywords input by users through the input module or voice recognition module of the game interface. These keywords represent the main emotions or themes that users want to express in the lyrics. The system will perform semantic analysis on the keywords to ensure that the subsequently generated lyrics can accurately reflect the needs of users. For example, when a user enters the keyword "dream", the system will use the emotion and theme of the keyword as the core basis for the creation of lyrics and accompaniment.

[0052] S20: Confirm the user's dancing level.

[0053] The user's dance level refers to an evaluation result of the user's dance ability based on the user's historical performance, input information, or real-time detection of the system. The user's dance level is used to adjust the speed, rhythm, and difficulty of the accompaniment so that the song matches the user's dance ability. Exemplarily, the dance level can be divided into elementary, intermediate, and advanced dancers, and different levels require accompaniment with different complexity and difficulty.

[0054] Optionally, the system can extract data from the user's history, such as the user's performance score in the dance game, the complexity of the dance moves completed, etc. Then based on this data, the system will evaluate the user's dance level and classify them as beginner, intermediate or advanced dancers.

[0055] In other embodiments, users can manually select their own dance level in the system's setting interface and provide their own subjective judgment of dance ability.

[0056] In other embodiments, if the system is connected to a somatosensory device (such as a camera, somatosensory sensor, etc.), the user's real-time movements can be captured by the device, and indicators such as sensitivity, movement amplitude and sense of rhythm can be analyzed to derive the user's real-time dance level.

[0057] S30: Generate accompaniment requirements according to the keywords and the dance level.

[0058] Among them, accompaniment requirements refer to the generation of a set of parameters related to the accompaniment based on the keywords entered by the user and the determined dance level. This set defines the core features of the accompaniment, including rhythm, chord progression, instrument configuration, dynamic changes, etc.

[0059] Specifically, the system first performs semantic analysis and sentiment analysis on the keywords input by the user. The system uses natural language processing technology, combined with a preset vocabulary library or through word vector models (such as Word2Vec, GloVe) to expand keywords, and recognizes the sentiment of keywords to determine the emotional tone (such as "happy", "melancholy") and music style (such as "popular", "jazz") expressed by the keywords.

[0060] Then, the system adjusts the specific parameters of the accompaniment according to the dance level. For example, if the user's dance level is low, the system will choose a slower tempo (such as 80BPM), simpler chord progressions (such as I-IV-VI), and reduce the complexity of the instruments (such as only using piano and drums). If the user's dance level is high, the system can increase the tempo (such as 120BPM), choose more complex chord progressions, and add more instrument configurations (such as piano, strings, percussion, etc.).

[0061] Optionally, the generated accompaniment requirements may include beats, rhythms, chords, instrument configurations, and the like.

[0062] It can be understood that by combining the emotional attributes of the keywords and the user's dance level, it is possible to ensure that the accompaniment is consistent with both the emotional expression and the user's ability.

[0063] S40: generating an accompaniment that meets the accompaniment requirement through a preset music model according to the accompaniment requirement.

[0064] The music model refers to a generative AI model trained on large-scale music data. The model can generate high-quality accompaniment that meets the input accompaniment requirements.

[0065] Specifically, after the generation requirements of the accompaniment are clarified, the system can generate the corresponding accompaniment by calling the preset music model and inputting the various parameters in the accompaniment requirements. The accompaniment generated by the model will be saved in the system's memory for use in the subsequent lyrics generation step.

[0066] S50: Filtering appropriate initial dance movements from a preset dance movement library according to the dance level.

[0067] The dance action library refers to a collection of different dance actions preset in the system, and the action library contains dance actions suitable for different styles and difficulties. The initial dance action refers to a set of actions selected from the dance action library that is suitable for the user's dance level.

[0068] Specifically, the system selects appropriate dance moves from the dance move library based on the user's dance level. For beginners, the system selects simple, basic dance moves; for advanced users, it selects more complex and challenging moves. The initial dance moves will serve as the basis for the subsequent generation of a complete dance move sequence to ensure that the moves match the user's ability.

[0069] S60: Generate a dance action sequence matching the accompaniment according to the accompaniment and the initial dance action.

[0070] Among them, the dance movement sequence refers to a complete combination of dance movements generated according to the accompaniment rhythm and the initial dance movements.

[0071] Specifically, the system first analyzes the musical structure of the accompaniment (such as rhythm, beat, and melody changes), and then selects movements that match the accompaniment style and rhythm from the initial dance movements based on these features. The system matches appropriate dance movements to each segment according to different segments of the music (such as the main song, climax, etc.), and sorts them to generate a coherent dance movement sequence. In addition, the system can also insert transition movements when the emotions or rhythms of adjacent music segments change to ensure the smoothness of the dance movements.

[0072] S70: Generate lyrics requirements according to the accompaniment and the keywords.

[0073] Among them, lyrics requirements refer to the lyrics parameter settings generated according to the structural characteristics of the accompaniment (such as rhythm, beat, segmentation, etc.) and the keywords input by the user. Optionally, lyrics requirements include specific requirements such as sentence structure, rhythm, length, and emotional progression.

[0074] Specifically, after generating the accompaniment through the music model, the system can further analyze the generated accompaniment, including its rhythm structure, segmentation method, emotional changes, etc. Then, according to the beat and emotional tone of the accompaniment, determine the sentence pattern, rhythm and segmentation method that the lyrics need to adopt. For example, in a 4 / 4 beat accompaniment, the system will set the AABB or ABAB rhythmic structure for the lyrics to ensure that the number of syllables in the lyrics matches the beat of the accompaniment. Finally, the system combines the keywords entered by the user to further generate lyrics requirements.

[0075] It can be understood that through the above operation, it can be ensured that the generated lyrics can be closely integrated with the accompaniment, which not only meets the rhythm requirements of the music, but also can express the emotional keywords input by the user, thereby enhancing the harmony between the lyrics and the accompaniment.

[0076] S80: Generate lyrics that meet the lyrics requirements through a preset natural language model according to the lyrics requirements.

[0077] The natural language model refers to a generative AI model that has been trained with large-scale natural language data. The model can generate lyrics that match the rhythm and emotional tone of the music based on the input lyrics requirements.

[0078] Specifically, after determining the lyrics requirements, the preset natural language model can be called and the lyrics requirements can be input to generate the required lyrics.

[0079] For example, when the system generates a requirement of 6 syllables per line and AABB rhyme pattern, the model will automatically generate lyrics that conform to this pattern. At the same time, keywords will be focused on incorporating into the lyrics, especially in the chorus, where core keywords will appear repeatedly to strengthen emotions.

[0080] It can be understood that the lyrics generated through the above steps not only have the fluency of natural language, but also can accurately convey the theme and emotion expressed by the keywords input by the user. The generated lyrics will form a unified artistic expression with the accompaniment and have higher harmony.

[0081] S90: Combining the accompaniment, dance action sequence and lyrics to generate a custom dance video.

[0082] Among them, custom dance videos refer to videos that are generated by synchronizing accompaniment, dance sequence and lyrics for users to watch or interact with. This video combines the keywords, accompaniment, lyrics and dance movements entered by the user, and is the personalized dance video that is finally presented to the user.

[0083] Specifically, the system combines the generated accompaniment, dance sequence and lyrics to generate a complete video. The video can include a virtual character or an animated character dancing to the accompaniment, and the generated lyrics are displayed synchronously on the screen. Users can watch their customized dance performance through the video, or interact with the dance moves in the video through somatosensory devices.

[0084] It can be understood that the somatosensory dance game method of the present application obtains the keywords input by the user and generates the corresponding accompaniment requirements and lyrics requirements in combination with the user's dance level, so that a customized dance video can be realized according to the user's personalized needs, thereby enhancing the user's personalized interactive experience. Among them, since the accompaniment requirements are determined based on the user's dance level and the input keywords, this not only enables the generated accompaniment to match the user's emotional expression, but also ensures that the rhythm and complexity of the accompaniment adapt to the user's dance ability, thereby enhancing the coordination and consistency of music and dance.

[0085] In addition, the lyrics requirements are generated based on the accompaniment structure and the keywords input by the user, so as to ensure that the generated lyrics can express the user's emotional needs and are consistent with the accompaniment in structure and emotion. In this way, the generated dance songs not only have a high level of musical and dance expressiveness, but also form a perfect unity between the lyrics content and the music style.

[0086] Moreover, since the dance movement sequence is generated by matching the music structure of the accompaniment with the user's dance level, the fluency and synchronization of the dance movements with the music are further improved, thereby enhancing the user's immersion and overall experience.

[0087] Therefore, compared with traditional somatosensory dance games, the somatosensory dance game method of the present application can achieve a higher degree of personalized customization and ensure a high degree of unity in rhythm, emotion and structure among music, lyrics and dance movements, thereby greatly improving user participation and satisfaction.

[0088] In some embodiments, generating accompaniment requirements according to the keywords and the dance level includes:

[0089] S31. Determine basic music features of the accompaniment and their initial feature values ​​according to the dance level.

[0090] Among them, basic music features refer to the core attributes that constitute the music accompaniment, which determine the overall style, emotional expression and structure of the accompaniment. These features can be used to adjust the complexity, rhythm and emotional expression of the music to suit different dance styles and user levels.

[0091] Initial feature values ​​refer to the initial values ​​set for each basic music feature before the accompaniment is generated. They are set according to the user's dance level and the system's default parameters, representing the basic configuration of the accompaniment.

[0092] Exemplarily, the basic musical features of the accompaniment include, but are not limited to: duration, tempo (BPM), beat type, chord progression, dynamic changes, rhythmic pattern, instrument configuration, harmonic structure, etc. Each musical feature has its corresponding initial feature value, which determines the basic properties of the accompaniment.

[0093] Tempo refers to the speed of the music, usually expressed in beats per minute (BPM). Tempo determines the speed of the dancer's movements and also affects the overall emotional tone of the music. Slower tempos (such as 60-80 BPM) are usually associated with calm, lyrical emotions, while faster tempos (such as 120-140 BPM) are associated with exciting, dynamic emotions.

[0094] The beat type refers to the basic beat structure of the music, such as 4 / 4, 3 / 4, or 6 / 8. The beat type affects the pace of the dance movements and the rhythm of the music. For example, 4 / 4 is the most common beat type and is suitable for many dance styles, while 3 / 4 is often used for more elegant dances such as waltzes.

[0095] A chord progression is a pattern in which a series of chords evolve in a certain order, which determines the harmonic structure and emotional expression of the music. Simple chord progressions (such as I-IV-VI) are suitable for pop music and elementary dancers, while complex chord progressions (such as those containing seventh chords, ninth chords, etc.) are suitable for jazz music or more advanced dancers.

[0096] Dynamic changes refer to changes in the volume and intensity of music, which affect the emotional tension of the music. Strong dynamic changes in music can bring greater emotional impact, while relatively gentle dynamic changes are suitable for expressing soft or calm emotions.

[0097] Rhythmic patterns determine the complexity, density and rhythm of the music.

[0098] The instrument configuration determines the types and combinations of instruments used in the music. Simple instrument configurations (such as piano and drums) are suitable for dance styles with clear rhythms, while complex configurations (such as strings, percussion, synthesizers, etc.) are suitable for more complex and layered dances.

[0099] Harmonic structure refers to the layering of multiple notes or chords in the accompaniment. A simpler harmonic structure may only have one layer of harmony, while a more complex harmonic structure can contain the harmony of multiple tracks at the same time, creating a richer musical experience.

[0100] Specifically, the system will set an initial value for each basic music feature of the accompaniment according to the user's dance level.

[0101] For beginners, the system will choose a slower tempo (such as 80BPM), a simple 4 / 4 time, a basic I-IV-VI chord progression, and fewer instrument configurations (such as piano and percussion).

[0102] For advanced dancers, the system might select faster tempos (such as 120 BPM), more complex beat types (such as 6 / 8), chord progressions that incorporate seventh chords, and richer instrument configurations (such as piano, strings, and percussion).

[0103] S32: Perform sentiment and style analysis on the keyword to determine the sentiment tone and style type corresponding to the keyword.

[0104] Among them, emotional tone refers to the type of emotion conveyed by the keyword, such as positive, negative, calm, passionate, etc. By performing sentiment analysis on keywords, the system can understand the core emotion that the user wants to express. For example, the keyword "happy" will be identified as a positive emotion, while "lonely" may represent a negative emotion.

[0105] Style type refers to the music style corresponding to the keyword, such as pop, jazz, electronic, folk, etc. The system can determine the most suitable music style for the keyword by analyzing the association between the keyword and the preset music style library. For example, the keyword "party" may correspond to the electronic music style, while "forest" may match the folk style.

[0106] Specifically, natural language processing technology can be used, combined with sentiment dictionaries and style classification models, to analyze the semantics and sentimental connotations of keywords. Through sentiment analysis, the system can understand the sentimental expression of keywords and determine the most appropriate musical style. This provides guidance for the style and sentimental expression of the accompaniment.

[0107] S33: Optimizing the basic music features and their feature values ​​based on the emotional tone and style type.

[0108] Among them, optimization refers to adjusting the initial feature values ​​of the basic music features based on the determined emotional tone and style type to ensure that the accompaniment can both express the emotions of the keywords and fit the user's dance level.

[0109] Specifically, the system first screens the basic music features that are closely related to the emotional tone and style type, such as rhythm speed, chord progression, instrument configuration, etc. Then, the system optimizes and adjusts the initial values ​​of these features according to the emotional tone and style type. For example:

[0110] If the emotional tone is "excited", the system may increase the tempo (such as from 90BPM to 120BPM) and use richer percussion.

[0111] If the style type corresponding to the keyword is "popular", the system will select brighter instruments (such as piano and guitar) and adjust the chord progression to suit the pop music style.

[0112] If the emotion is "sad", the system may reduce dynamic changes and use minor chord progressions to create a gloomy atmosphere.

[0113] S34, generating the accompaniment requirement according to the optimized basic music features and their feature values.

[0114] In this embodiment, the accompaniment requirement refers to an accompaniment parameter set generated by the aforementioned optimized music features, which is used to guide subsequent accompaniment generation.

[0115] Specifically, the system uses the optimized basic music features as components of the accompaniment requirements, including but not limited to the following:

[0116] Tempo (e.g. BPM): Make sure the tempo matches the dance and the emotional expression.

[0117] Beat type: Determine the appropriate beat structure based on the style of the keyword (e.g. 4 / 4 is suitable for pop music, 3 / 4 is suitable for folk music, etc.).

[0118] Chord progressions: Choose chord changes that fit the emotion being expressed and make sure the music matches the emotion.

[0119] Dynamics and instrumentation: Adjust instrumentation and dynamics based on the emotional tone (e.g., louder volume and richer instrumentation for strong emotions, fewer dynamics for calmer emotions).

[0120] Harmonic structure: The complexity of the harmonic levels is determined by the style type and emotional needs.

[0121] In this way, based on the optimized accompaniment requirements, it can be ensured that the generated accompaniment is consistent with the user's dance level and can express the emotion and style of the keywords.

[0122] It can be understood that by combining the keywords and dance level input by the user to generate accompaniment requirements and then optimizing the basic music features, it is ensured that the accompaniment is consistent with the user's emotional expression and can adapt to the user's dance ability, thereby generating customized music accompaniment. Therefore, users can not only obtain accompaniment that matches their dance ability, but also express personalized emotional needs through the system. In addition, by analyzing and optimizing the emotional tone and style type of the keywords, the generated accompaniment can accurately reflect the theme and style input by the user, thereby enhancing the fit between the music and the user's expectations.

[0123] In some embodiments, determining the basic music features of the accompaniment and its initial feature value according to the dance level includes:

[0124] S311. Determine basic music features of the accompaniment according to preset basic music feature categories.

[0125] Among them, the preset basic music feature categories refer to the key features that constitute the music accompaniment, which may include rhythm patterns, dynamic changes, instrument configurations, chord progressions, harmonic structures, etc. Each category represents a different dimension of the accompaniment and determines the overall style and expressiveness of the accompaniment.

[0126] Specifically, when generating the accompaniment, the system selects appropriate music features from a preset library of basic music feature categories to ensure that the accompaniment meets the user's dance needs and expected style. By determining these basic music features, the system provides a framework for the generation of the accompaniment, ensuring that the accompaniment covers all aspects required for dance performance.

[0127] S312: Determine the initial feature value of the basic music feature in a preset dimension according to the level corresponding to the dance level.

[0128] Among them, the level corresponding to the dance level is determined according to the user's dance ability (such as beginner, intermediate dancer, advanced dancer). The user's dance level affects the difficulty, rhythm speed and complexity of the accompaniment.

[0129] The initial feature value refers to the value initially set for each preset dimension of the basic music feature when generating the accompaniment. Each basic music feature has different dimensions, which are used to control the detailed performance of the accompaniment. In this embodiment, the system dynamically adjusts the initial value of each feature dimension according to the user's dance level. The details are as follows:

[0130] Dynamically changing preset dimensions:

[0131] Dynamic intensity: Indicates the amplitude of volume changes in the accompaniment. For beginners, the system will select a lower dynamic intensity to ensure that the volume changes in the accompaniment are not drastic; while for advanced dancers, the system may increase the dynamic intensity to enhance the emotional impact of the accompaniment.

[0132] Frequency of change: Indicates how often the volume changes. Beginners may have a lower frequency of changes in their accompaniment, while advanced dancers may need more frequent changes in volume and dynamics to match complex dance movements.

[0133] Preset dimensions for instrument configuration:

[0134] Instrumental richness: Indicates the types of instruments used in the accompaniment. For beginners, the system may choose a small instrument configuration, such as piano and basic percussion; while for advanced dancers, the system will increase the instrumental richness, adding more strings, wind instruments, etc.

[0135] Timbre Brightness: Indicates the high-frequency elements of the instrument's timbre. A beginner's accompaniment may use warmer timbres (such as instruments with more low frequencies), while an advanced dancer's accompaniment may contain more bright instrumental timbres (such as trumpets, flutes, etc.).

[0136] Percussion ratio: This indicates the proportion of percussion in the accompaniment. Beginners may need less percussion to keep a simple rhythm, while advanced dancers may need more percussion to enhance the rhythm.

[0137] Preset dimensions of rhythmic patterns:

[0138] Complexity: Indicates the complexity of the accompaniment rhythm. For beginners, the system will choose a simpler rhythm structure, while advanced dancers will increase the complexity of the rhythm, such as introducing more syncopated rhythms and irregular beats.

[0139] Density: refers to how often the notes appear in the accompaniment. A beginner's accompaniment may have fewer notes, while an advanced dancer's accompaniment may require a higher density of notes to match the complex dance movements.

[0140] Groove: This refers to the danceability of the accompaniment. Advanced dancers may need a stronger groove, while beginners may need music with a more steady tempo that is easy to follow.

[0141] Preset dimensions for chord progressions:

[0142] Tonal pattern: This refers to the tonal structure of the accompaniment. Beginners' accompaniment usually uses a major key (bright and simple), while advanced dancers may use a more diverse tonal pattern such as a minor key, polyphony, etc.

[0143] Chord Complexity: Indicates the complexity of the chords. For beginners, the system may choose simple triads, while for advanced dancers, the system will add more complex chord variations, such as seventh chords, ninth chords, etc.

[0144] Chord Change Rate: This indicates how often the chords change. Beginners may have slower chord changes in their accompaniment, while advanced dancers may need more frequent chord changes to match the changes in dance moves.

[0145] Harmonic stability: Indicates the harmony and tension of the chord progression. A beginner's accompaniment may have higher harmonic stability, which is suitable for simple musical structures, while an advanced dancer may need to add more dissonance and tension to the chord changes to increase the emotional tension of the music.

[0146] Preset dimensions of harmonic structure:

[0147] Harmonic level: refers to the level of harmony in the accompaniment. A beginner's accompaniment may contain a simple layer of harmony, while an advanced dancer's accompaniment may add more layers of harmony to enhance the complexity and expressiveness of the music.

[0148] Harmonic density: This refers to how close together the notes are in a harmony. A beginner's accompaniment may have looser harmonies, while an advanced dancer's accompaniment may require a tighter harmony configuration.

[0149] Harmonic extension: refers to the extension of harmony in time and interval. The accompaniment of beginners has less harmonic extension, while the accompaniment of advanced dancers may add more extended harmony to give the music a wider sense of space and depth.

[0150] It can be understood that the above embodiment sets the basic music features and initial feature values ​​of the accompaniment according to the user's dance level, ensuring that the rhythm, chords, instruments and other features of the accompaniment can adapt to the user's dance ability. At the same time, dynamic changes, instrument configurations, rhythm patterns, chord progressions, harmonic structures, etc. are initially set in multiple dimensions according to different dance levels, so that the accompaniment can not only express the user's emotional needs, but also provide music support that meets their dance expressiveness.

[0151] In some embodiments, based on the emotional tone and style type, the basic music features and their feature values ​​are optimized, including:

[0152] S331. Filter music features associated with the emotional tone and style type from the basic music features as custom music features.

[0153] Among them, custom music features refer to music features that are directly related to emotional expression and style requirements. The system will select the features that can best affect the emotional expression of music for adjustment through analysis of emotional tone and style type. For example:

[0154] For a keyword whose emotional tone is "excited" and whose style type is "electronic music", rhythm patterns, instrument configurations, dynamic changes, etc. may be screened out as custom music features.

[0155] If the emotional tone is "melancholy" and the style type is "jazz", the system may select chord progression, harmonic structure, and instrument configuration as the main features.

[0156] Specifically, the system first analyzes all dimensions in the basic music features, and selects core features such as rhythm, dynamics, chords, instrument configuration, etc. through the correlation with emotional tone and style type. These custom music features will determine the optimization direction of subsequent accompaniment.

[0157] S332: Calculate the influence coefficient of the emotional tone and the style type on the associated music features.

[0158] The influence coefficient is a value that measures the degree of influence of emotional tone and style type on custom music features. By calculating the influence coefficient, the system can determine how each custom music feature should adjust its initial feature value to better express the user's emotional needs.

[0159] Optionally, the influence factor can be set to a value between -1 and 1:

[0160] Positive values: Indicates that the emotional tone and style type need to enhance a certain feature. The closer the coefficient is to 1, the greater the adjustment of the feature. For example, for the emotion of "excitement", the influence coefficients of rhythm (BPM) and dynamic changes may be close to 1, which means that the system needs to significantly speed up the rhythm and enhance the dynamic changes.

[0161] Negative values: Indicates that the emotional tone and style type need to weaken a certain feature. The closer the coefficient is to -1, the more significantly the feature needs to be weakened. For example, for the emotion of "melancholy", the harmonic stability of the chord may have a negative influence coefficient, and the system may choose to introduce more dissonance and reduce stability.

[0162] The method for calculating the influence coefficient can be based on a pre-trained sentiment analysis and style matching model. The model analyzes the typical change patterns of various musical features under different sentiments and styles based on a large amount of music data. For example, for the emotion of "happiness", the system may calculate a positive rhythm acceleration influence coefficient, while for the emotion of "sadness", the system may calculate a negative influence coefficient of reduced harmony complexity.

[0163] S333: Apply the influence coefficient to the initial feature value of the custom music feature to adjust the custom music feature to optimize the basic music feature.

[0164] The initial feature values ​​of the custom music features are the default values ​​set in the previous stage according to the user's dancing level. In this step, the system will adjust these feature values ​​by applying the influence coefficients of emotional tone and style type, and finally optimize the music features.

[0165] Specifically, the system adjusts the initial feature value of each custom music feature according to the following formula:

[0166] T final =T initial +(T max -T min )×α;

[0167] Among them, T final is the feature value of the adjusted music feature;

[0168] T initial is the initial eigenvalue;

[0169] T max and T min is a preset maximum value and a preset minimum value of the music feature;

[0170] α is the influence coefficient of emotional tone or style type.

[0171] It is worth noting that in the above formula, by introducing T max and T min The two features can be adjusted by setting reasonable upper and lower limits to control the adjustable range of each music feature, ensuring that the adjusted music feature values ​​(such as rhythm, chord complexity, dynamic changes, etc.) do not exceed a reasonable range. This can prevent the feature values ​​from being too large or too small, affecting the quality and adaptability of the music.

[0172] For example, the influence coefficients of emotional tone and style type may have large values ​​(close to 1 or -1) in some cases, and if these influence coefficients are directly applied, the feature values ​​may be too extreme. For example, an angry emotional tone may result in a too fast rhythm or too large dynamic changes, while a sad emotional tone may make the chord progression too simple or monotonous.

[0173] In addition, the introduction of T max and T min The two features allow feature adjustment to be flexible according to different emotional tones or style types, while maintaining a certain stability. At the same time, different styles of music have different expectations for certain features. By setting specific T for different music styles, max and T min , the system is also able to provide personalized adjustment range for each music style.

[0174] Of course, in some embodiments, the influence coefficient may also be applied to the eigenvalue to obtain the final optimized eigenvalue.

[0175] For example, if the initial rhythm value is 90 BPM, the emotional tone is "excited", the influence coefficient is 0.7, the maximum rhythm value is 140 BPM, and the minimum value is 60 BPM, then the calculated rhythm value is:

[0176] T final=90+(140-60)×0.7=90+80×0.7=90+56=146.

[0177] After adjustment, the tempo is accelerated to 146BPM, which meets the needs of passionate emotions.

[0178] For example, if the initial harmony stability is 8, the emotional tone is "melancholy", the influence coefficient is -0.5, the maximum value is 10, and the minimum value is 2, then the calculated harmony stability is:

[0179] T final=8+(10-2)×(-0.5)=8-4=4.

[0180] The adjusted harmonic stability is reduced to 4, introducing more dissonant notes, which fits the expression of melancholic emotions.

[0181] Through these adjustments, the system can optimize the various custom musical features of the accompaniment, ensuring that the accompaniment is more accurate in emotional expression and matches the user's dancing ability.

[0182] It can be understood that this embodiment combines the emotional tone and style type, selects the music features that are highly correlated with them as the custom music features, and calculates and optimizes the influence coefficients, thereby ensuring that the generated accompaniment can accurately express the user's emotional needs and meet the specified style type. By optimizing the custom music features, the system not only improves the emotional expression of the accompaniment, but also enables the accompaniment to be coordinated with the dance movements, further enhancing the user experience.

[0183] In some embodiments, generating a dance action sequence matching the accompaniment according to the accompaniment and the initial dance action includes:

[0184] S61, analyzing the music structure of the accompaniment, identifying different music segments in the accompaniment, and determining the rhythmic characteristics and emotional tone of each music segment.

[0185] The musical structure of the accompaniment refers to the overall layout and composition of the accompaniment, including different musical segments, such as the prelude, verse, chorus, bridge, and ending. Each musical segment may have different rhythmic and emotional characteristics. Rhythmic characteristics include beat, speed, and rhythm, while the emotional tone is the emotion expressed by the accompaniment in a specific segment, such as excitement, melancholy, relaxation, etc.

[0186] Specifically, the system will analyze the audio features of the accompaniment, identify the structure of the accompaniment and divide it into different music segments. For example, the system can identify the verse and chorus of the accompaniment, determine the rhythm speed (such as BPM value) and beat type (such as 4 / 4 or 3 / 4) of each segment, and extract the emotional tone of the segment (such as the verse is soft and the chorus is passionate). These data will provide a basis for the selection and arrangement of subsequent dance moves.

[0187] S62: Select matching dance moves from the initial dance moves according to the rhythm features and emotional tone of the music clip.

[0188] The initial dance moves refer to a set of moves pre-selected from a dance move library based on the user's dance level. The system will select dance moves that match the rhythmic characteristics (such as speed, strength) and emotional tone of each music clip from the initial dance moves.

[0189] Specifically, the system matches the rhythmic characteristics and emotional tone of the accompaniment clip with the difficulty, rhythmic sense and emotional expression of the initial dance movements. For example:

[0190] For clips with a slower tempo and a calmer emotional tone, the system might choose softer, more fluid dance moves, such as waving hands or slow steps.

[0191] For a chorus with a faster tempo and a stronger emotional tone, the system might choose a dance move with large movements and a strong sense of rhythm, such as a jump or a spin.

[0192] In this way, the dance movements are ensured to be coordinated with the rhythm and emotional expression of the accompanying music, thereby enhancing the synchronization and expressiveness of music and dance.

[0193] S63: Arrange the dance movements based on the order of the music structure to generate a dance movement sequence matching the accompaniment.

[0194] Specifically, the system will arrange the selected dance moves into a complete sequence based on the timeline and order of the music clips. For example, the system will select simple preparatory movements in the prelude, more coherent movements in the verse, and larger movements in the chorus. The climax of the music will be matched with faster and more explosive dance moves, while at the end of the music, the system may choose slower movements with a stronger sense of ending. Through this arrangement, the generated dance move sequence can be presented synchronously with the accompaniment and enhance the user's dance performance experience.

[0195] It can be understood that by analyzing the musical structure of the accompaniment, different music clips in the accompaniment can be identified, and the rhythm characteristics and emotional tone of each clip can be determined, thereby providing a basis for the selection of dance movements. In addition, the system selects matching dance movements from the initial dance movements based on the rhythm and emotional characteristics of these music clips to ensure that the dance movements are highly coordinated with the rhythm and emotion of the accompaniment. By arranging these dance movements in the order of the musical structure, the generated dance movement sequence can be synchronized with the accompaniment, thereby enhancing the overall expressiveness of music and dance and enhancing the user's immersion and interactive experience.

[0196] In some embodiments, generating a dance action sequence matching the accompaniment according to the accompaniment and the initial dance action further includes:

[0197] S631. Calculate the rhythm changes and emotional transitions between adjacent music clips.

[0198] Among them, rhythm change refers to the difference between two adjacent music clips in terms of speed, beat, rhythm, etc. For example, the previous clip may have a slower rhythm, while the next clip may have a fast and intense rhythm. Emotional transition refers to the change in the emotional tone of a music clip, such as from calm to exciting, from relaxed to tense, etc.

[0199] Specifically, the system analyzes the rhythmic features and emotional tone of two adjacent music clips and calculates the degree of change between them. For example, if the first clip has a slow rhythm and a relaxed emotional tone, while the second clip has a significantly faster rhythm and an exciting emotional tone, the system will record this significant change in rhythm and emotion. These changes will serve as the basis for selecting appropriate transitional dance moves.

[0200] S632: When the rhythm change and / or emotional transition meets a preset standard, a transition dance movement matching the rhythm change and / or emotional transition is selected from a preset transition movement library.

[0201] The preset standard refers to the threshold set by the system to measure the degree of rhythm change and emotional transition between adjacent music clips. For example, when the rhythm change reaches a certain degree (such as the BPM increase of more than 20%) or the emotional transition is significant, the system considers that a transition action needs to be inserted.

[0202] The transition library is a database of various dance transitions that are specifically designed to maintain the continuity of the dance when changing between music segments.

[0203] Transition dance movements refer to the intermediate movements used to connect the dance movements of adjacent music clips to ensure the smoothness and natural transition of the dance movements. The system inserts these transition movements between the dance movements of two different clips to ensure the smooth connection of the dance movements.

[0204] Specifically, the system will determine whether the rhythm changes or emotional transitions of adjacent music clips meet the preset standards. For example, when the rhythm changes from slow to fast, or the emotion changes from relaxed to passionate, the system will select transitional dance moves that match the change from the transitional move library. These transitional moves may include light step adjustments, arm swings, or adjustments to body postures to smoothly connect the dance moves of the two clips and avoid sudden jumps or incoordination.

[0205] S633: insert the selected transitional dance movement between the dance movements corresponding to two adjacent music clips.

[0206] Specifically, the system will automatically insert the selected transitional dance movements after determining the corresponding dance movements between two adjacent clips. For example, between a slow dance step and a fast rotation, a slight step movement or body swing is inserted to make the transition more natural. When the rhythm or emotion changes greatly, the addition of these transitional movements can effectively avoid sudden switching of movements and improve the coherence of the overall dance.

[0207] It can be understood that by calculating the rhythm changes and emotional transitions between adjacent music clips, the system can identify significant changes in rhythm and emotion, and thus decide whether transitional movements are needed. By selecting transitional dance movements that match these changes and inserting these transitional movements into the dance movement sequence, the system can ensure smooth connection between adjacent dance movements and avoid sudden jumps or incoordination of movements. In this way, the synchronization and coherence of dance movements and accompaniment are improved, thereby enhancing the user experience and dance expressiveness, and enhancing the interactive effect of music and dance.

[0208] In some embodiments, generating lyrics requirements according to the accompaniment and the keywords includes:

[0209] S71. Determine structural requirements of the lyrics based on the accompaniment, wherein the structural requirements include at least one of sentence pattern, rhythm, length, segmentation, and emotional progression.

[0210] Among these, the structural requirements of the lyrics refer to determining the structural form requirements of the lyrics based on factors such as the rhythm, beat, chord progression, and emotional expression of the accompaniment.

[0211] Specifically, this step first analyzes the rhythm, beat, and segmentation of the accompaniment to generate lyrics that meet the accompaniment structure. For example:

[0212] Sentence pattern: The rhythm and melody of the accompaniment determine the sentence pattern of the lyrics. A relatively stable 4 / 4 accompaniment is suitable for a symmetrical sentence pattern (such as AABB rhythm), while a more complex accompaniment may require an irregular sentence pattern (such as ABAB rhythm).

[0213] Rhythm: The system determines the rhyme pattern of the lyrics based on the rhythmic characteristics of the accompaniment to ensure that the rhyme of the lyrics matches the rhythm of the accompaniment. For example, the AABB or ABAB rhythmic structure commonly used in pop music can enhance the unity of lyrics and melody.

[0214] Length: The length of each sentence of the lyrics (i.e. the number of words or syllables) needs to match the length of the accompaniment melody. For each measure of the accompaniment, the system determines the syllable length of the lyrics based on the beat type and rhythm. For example, a fast rhythm requires shorter sentences, while a slower accompaniment is suitable for longer sentences.

[0215] Segmentation: Based on the segmentation structure of the accompaniment (such as verse, chorus, bridge, etc.), the system determines the segmentation requirements of the lyrics. The chorus usually requires relatively concise and repetitive lyrics, while the verse part can accommodate more narrative content.

[0216] Emotional progression: The emotional changes in the accompaniment determine the level of emotional expression in the lyrics. For example, the climax of the accompaniment may require lyrics with stronger emotions, while the flat part can use gentler expressions.

[0217] Through this step, the system can generate lyrics structure requirements that match the accompaniment structure, ensuring that the lyrics are closely matched with the accompaniment in rhythm and form.

[0218] S72: Determine the content requirements of the lyrics based on the keywords.

[0219] Among them, the content requirements of the lyrics are specific lyrics content determined based on keywords, including keyword expansion, emotional expression and priority setting.

[0220] Specifically, this step first expands the keywords input by the user through semantic analysis. For example, the system can generate expanded words related to the keywords based on the synonyms and associated words of the keywords. For example, inputting "love" can expand words such as "attachment", "heartbeat", and "sweetness" to enrich the expression level of the lyrics.

[0221] Secondly, the system uses a sentiment analysis model to identify the emotional tone expressed by the keywords and determine the emotional level that the lyrics need to convey. For example, the keyword "lonely" may express a negative emotion, so the system will generate lyrics that are more suitable for melancholy or contemplative emotions.

[0222] Finally, the system assigns priorities to keywords. Core keywords usually appear multiple times in the lyrics of the chorus or climax, while secondary keywords appear in the verse or background description. For example, "love" as a core keyword may be used repeatedly in the chorus, while "summer" as a secondary keyword can be used in the background description of the verse.

[0223] Through this step, the system determines the specific content requirements for the generation of lyrics, ensuring that the lyrics can accurately convey the emotions and themes input by the user.

[0224] S73. Generate the lyrics requirement according to the structure requirement and the content requirement.

[0225] In this embodiment, the lyrics requirement is a complete parameter set generated by combining the lyrics structure requirement and the content requirement, and is used to guide the subsequent lyrics generation.

[0226] Specifically, the system combines structural requirements with content requirements to ensure that the generated lyrics not only match the rhythm and rhyme of the accompaniment, but also convey the emotion of the keywords entered by the user. For example:

[0227] The system will set the number of words and rhyme pattern in each line of the lyrics according to the beat and segmentation of the accompaniment, and ensure that the core keywords can be naturally integrated into the sentence structure of the chorus.

[0228] The need for emotional progression is combined with the need for content to ensure that the lyrics can gradually increase or decrease as the emotions of the accompaniment change. For example, the keyword "happy" may be expressed with stronger words in the chorus, while a milder word may be used to express the background emotion in the verse.

[0229] Through this step, the system finally generates lyrics that meet user expectations and match the accompaniment, covering the structure, content and emotional expression of the lyrics.

[0230] It can be understood that this embodiment determines the structural requirements of the lyrics based on the accompaniment, and generates the content requirements of the lyrics in combination with the keywords input by the user, so as to ensure that the generated lyrics can be closely matched with the accompaniment in terms of sentence structure, rhythm, length, etc., while conveying the emotions and themes that the user wants to express. In this way, the lyrics are coordinated with the accompaniment in terms of emotional expression and rhythm performance, and the quality of lyrics generation and user experience are improved.

[0231] In some embodiments, determining the content requirements of lyrics based on the keywords includes:

[0232] S721. Perform semantic expansion and sentiment optimization on the keywords to generate an expanded keyword set.

[0233] Among them, semantic expansion refers to expanding these keywords through natural language processing technology to generate related vocabulary, thereby enriching the expression content of the lyrics. Emotional optimization refers to selecting appropriate extended vocabulary based on the emotional tone of the keywords to ensure that the expanded vocabulary conforms to the emotional expression of the original keywords.

[0234] Specifically, this step first expands the keywords through a semantic network or a pre-trained word vector model (such as Word2Vec, GloVe, etc.). For example:

[0235] The keyword "love" can be expanded to related words such as "attachment", "heartbeat", and "sweetness";

[0236] The input keyword "loneliness" may expand to words such as "loneliness", "aloneness", and "missing".

[0237] Next, the system optimizes and selects based on the emotional tone of the keyword. For example, if the keyword expresses positive emotions (such as "happy"), the system will give priority to words that express positive emotions, such as "smile" and "sunshine"; if the keyword expresses negative emotions (such as "sad"), the system will choose words that express negative emotions, such as "tears" and "night".

[0238] Through this step, the system generates an expanded keyword set, the words in which can enrich the content of the lyrics and conform to the emotional tone expressed by the keywords.

[0239] S722: Determine the priority of the keywords in the keyword set.

[0240] Among them, priority refers to the importance of keywords in the lyrics, which determines which words need to appear repeatedly in the core position of the lyrics and which words can appear as auxiliary descriptive words.

[0241] Specifically, the system determines the priority of each extended keyword based on factors such as the keyword's emotional importance and semantic relevance. Generally speaking, keywords directly entered by users will be set as core keywords with a higher priority, while keywords generated through semantic expansion will be set as secondary keywords with a lower priority. For example:

[0242] The keyword "love" is set as a high priority, which means that it will appear many times in the lyrics of the chorus or climax.

[0243] The extended word "holding hands" might be assigned a medium priority and appear in the narrative section of the verse.

[0244] Other auxiliary words such as "smile" and "sunshine" are set to low priority and used for background description.

[0245] By prioritizing the expanded set of keywords, the system ensures that core emotions and themes are fully expressed when lyrics are generated, while secondary vocabulary is used to enhance the richness of the lyrics.

[0246] S723: Determine the position distribution of the keywords in the lyrics according to the music structure of the accompaniment and the priorities of the keywords.

[0247] Among them, position distribution refers to the arrangement of different keywords in the specific positions of the lyrics according to the musical structure of the accompaniment (such as verse, chorus, bridge, etc.) and the priority of the keywords. The rhythm and segment structure of the accompaniment directly affect the layout of the lyrics. The core keywords usually appear in the chorus or important positions, while the secondary keywords are distributed in the verse or bridge part.

[0248] Specifically, the system first analyzes the segmented structure of the accompaniment to determine the position and length of the verse, chorus, and bridge. Then, the system assigns the position of the keywords in the lyrics according to their priority. For example:

[0249] High-priority keywords, such as "love", will be placed at the end of the chorus or at the rhyme to ensure that the emotional expression is prominent and the memory point is strengthened.

[0250] Medium priority keywords, such as “holding hands,” may appear in the middle of the verse to describe the emotional context and development.

[0251] Low-priority keywords, such as "smile", may appear in bridge or transition paragraphs to supplement the context.

[0252] Through this step, the system can ensure the reasonable distribution of different keywords in the lyrics, so that the core emotions and secondary contents are balanced and fully expressed in the whole song.

[0253] S724: Generate content requirements of lyrics based on the keyword set and the position distribution.

[0254] In this embodiment, the content requirements of lyrics refer to specific lyrics parameters generated based on the expanded keyword set and position distribution, including the frequency of occurrence of keywords, the position in the sentence, and the level of emotional expression.

[0255] Specifically, the system combines the expanded keyword set with the position distribution to generate the final lyric content requirements. The system will arrange the specific frequency and position of the keywords according to the priority of the keywords and the structure of the accompaniment. For example:

[0256] In the chorus, the system arranges the high-priority keyword "love" to appear once every two sentences and ensures that it appears at the rhyme position to enhance emotional expression and sense of rhythm.

[0257] In the verse section, medium priority words such as “holding hands” appear at a lower frequency to describe the storyline or emotional background.

[0258] Low-priority words such as "sunshine" and "smile" appear in the bridge or at the beginning of the sentence as background descriptions to enhance the visual sense of the lyrics.

[0259] The generated lyrics content requirements include the occurrence position, frequency and coordination with the sentence structure of each keyword to ensure the unity of the lyrics and accompaniment structure and the coherence of emotional expression.

[0260] It can be understood that this embodiment generates a rich set of keywords by semantically expanding and optimizing the keywords, and reasonably determines the distribution of keywords in the lyrics through priority sorting and analysis of the accompaniment structure, ensuring that the lyrics content matches the rhythm, structure and emotional tone of the accompaniment. In addition, the generated lyrics content requirements can ensure that the core emotional vocabulary is fully expressed, while the secondary vocabulary is used to enhance the richness and layering of the lyrics, thereby improving the quality of lyrics generation and user experience.

[0261] In addition, the embodiment of the present invention also proposes a computer-readable storage medium, which can be any one or any combination of a hard disk, a multimedia card, an SD card, a flash memory card, an SMC, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, etc. The computer-readable storage medium includes a somatosensory dance game program 10 for a custom dance video. The specific implementation of the computer-readable storage medium of the present invention is roughly the same as the specific implementation of the somatosensory dance game method for a custom dance video and the server 1, which will not be repeated here.

[0262] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0263] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that specifies the functions of a block or multiple blocks.

[0264] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0265] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0266] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0267] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A somatosensory dance game method for customizing dance videos, characterized in that: include: Get the keywords entered by the user for customizing the dance video; Confirm the user's dancing level; Generate accompaniment requirements according to the keywords and the dance level; According to the accompaniment requirement, generating an accompaniment that meets the accompaniment requirement through a preset music model; According to the dance level, selecting appropriate initial dance movements from a preset dance movement library; Generating a dance movement sequence matching the accompaniment according to the accompaniment and the initial dance movement; Generate lyrics requirements according to the accompaniment and the keywords; According to the lyrics requirement, lyrics that meet the lyrics requirement are generated through a preset natural language model; The accompaniment, dance action sequence and lyrics are combined to generate a customized dance video.

2. The somatosensory dance game method of custom dance video according to claim 1, characterized in that: Generating accompaniment requirements according to the keywords and the dance level includes: Determine the basic music features of the accompaniment and its initial feature value according to the dance level; Performing sentiment and style analysis on the keywords to determine the sentiment tone and style type corresponding to the keywords; Based on the emotional tone and style type, optimizing the basic music features and their feature values; The accompaniment requirement is generated according to the optimized basic music features and their feature values.

3. The somatosensory dance game method of customizing dance videos as claimed in claim 2, characterized in that: Determining basic music features of the accompaniment and initial feature values ​​thereof according to the dance level includes: Determine the basic music characteristics of the accompaniment according to the preset basic music characteristic categories; According to the level corresponding to the dance level, the initial feature value of the basic music feature on the preset dimension is determined; wherein, The preset dimension of the dynamic change includes at least one of dynamic intensity and change frequency; The preset dimension of the instrument configuration includes at least one of instrument richness, timbre brightness and percussion ratio; The preset dimension of the rhythm pattern includes at least one of complexity, density and rhythmic sense; The preset dimension of the chord progression includes at least one of tonal mode, chord complexity, chord change rate and harmonic stability; The preset dimensions of the harmonic structure include at least one of harmonic level, harmonic density and harmonic extensibility.

4. The somatosensory dance game method of customizing dance videos as claimed in claim 3, characterized in that: Based on the emotional tone and style type, the basic music features and their feature values ​​are optimized, including: Selecting music features associated with the emotional tone and style type from the basic music features as custom music features; Calculating the influence coefficient of the emotional tone and the style type on the associated music features; The influence coefficient is applied to the initial feature value of the custom music feature to adjust the custom music feature to optimize the basic music feature.

5. The somatosensory dance game method of any one of claims 1 to 4, characterized in that: Generating a dance action sequence matching the accompaniment according to the accompaniment and the initial dance action, comprising: Analyzing the musical structure of the accompaniment, identifying different musical segments in the accompaniment, and determining the rhythmic characteristics and emotional tone of each musical segment; Selecting matching dance moves from the initial dance moves according to the rhythmic features and emotional tone of the music clip; The dance movements are arranged in a sequence based on the music structure to generate a dance movement sequence matching the accompaniment.

6. The somatosensory dance game method of customizing dance videos as claimed in claim 5, characterized in that: Generating a dance action sequence matching the accompaniment according to the accompaniment and the initial dance action, further comprising: Calculate rhythmic changes and emotional transitions between adjacent music clips; When the rhythm change and / or emotional transition meets a preset standard, selecting a transition dance action that matches the rhythm change and / or emotional transition from a preset transition action library; The selected transitional dance action is inserted between the dance actions corresponding to two adjacent music clips.

7. The somatosensory dance game method of customizing dance videos as claimed in claim 5, characterized in that: Generating lyrics requirements according to the accompaniment and the keywords includes: Determining the structural requirements of the lyrics based on the accompaniment, wherein the structural requirements include at least one of sentence pattern, rhythm, length, segmentation, and emotional progression; Determining the content requirements of the lyrics based on the keywords; The lyrics requirement is generated according to the structural requirement and the content requirement.

8. The somatosensory dance game method of customizing dance videos as claimed in claim 7, characterized in that: Determining the content requirements of the lyrics based on the keywords includes: Performing semantic expansion and sentiment optimization on the keywords to generate an expanded keyword set; Determining the priority of keywords in the keyword set; Determining the position distribution of the keywords in the lyrics according to the music structure of the accompaniment and the priority of the keywords; Based on the keyword set and the position distribution, the content requirements of the lyrics are generated.

9. A somatosensory dance game device for customized dance videos, characterized in that: The invention comprises a memory, a processor and a somatosensory dance game program for a custom dance video which is stored in the memory and can be run on the processor. When the processor executes the somatosensory dance game program for a custom dance video, a somatosensory dance game method for a custom dance video as described in any one of claims 1 to 8 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a somatosensory dance game program for a custom dance video, and when the somatosensory dance game program for a custom dance video is executed by a processor, the somatosensory dance game method for a custom dance video as described in any one of claims 1 to 8 is implemented.

Images