Method and apparatus for controlling robot to dance, electronic device, and storage medium

Abstract

Embodiments of the present application provide a method and device for controlling a robot to dance, electronic equipment and a storage medium, wherein the method for controlling the robot to dance comprises: obtaining target song score information and a basic action set supported by the robot; performing dance action arrangement based on the target song score information and the basic action set to generate a target dance action set of the target song score information; determining a dance action control instruction set corresponding to the target dance action set and sending the dance action control instruction set to the robot; wherein the dance action control instruction set is used for the robot to dance a target song, and the target song is a song corresponding to the target song score information. The present application can achieve the purpose of quickly arranging dances for dancing robots for various songs without relying on human factors, thereby greatly improving the variety and richness of dances that the dancing robot can dance.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method, apparatus, electronic device, and storage medium for controlling a robot to dance. Background Technology

[0002] With the continuous development and advancement of science and technology, robots are becoming increasingly diverse. Besides robotic vacuum cleaners, food delivery robots, and courier robots, dancing robots that can dance in place of the user have also emerged. Dancing robots can not only fill the void and boredom of the elderly and satisfy the curiosity of teenagers and children, but also inspire people's understanding and reinvention of new technologies. Therefore, how to control a dancing robot to dance is particularly important.

[0003] In related technologies, before a dancing robot can dance, the user usually needs to choreograph a dance move for a song or a piece of music based on the movements supported by the dancing robot. After the choreographed dance move is converted into motion control commands that the dancing robot can recognize, the motion control commands are sent to the dancing robot so that the dancing robot can dance according to the motion control commands.

[0004] However, existing dancing robots can only dance dances that have been choreographed by the user. For new songs, the user still needs to choreograph the dance moves again. As a result, dancing robots have to rely on human factors to choreograph the dance moves so that they can only dance a limited and fixed variety of dances. Summary of the Invention

[0005] This invention provides a method, apparatus, electronic device, and storage medium for controlling a robot to dance, which solves the defects of existing dancing robots that require human intervention to choreograph dance moves and that the types of dances they can perform are limited and fixed. This invention achieves the goal of quickly choreographing dances for various songs for dancing robots without relying on human intervention, thereby greatly improving the diversity and richness of the types of dances that dancing robots can perform.

[0006] This invention provides a method for controlling a robot to dance, applied to the ChatGPT platform which is communicatively connected to the robot. The method includes:

[0007] Obtain the sheet music information of the target song and the set of basic actions supported by the robot;

[0008] Based on the target song's sheet music information and the basic movement set, dance movements are choreographed to generate a target dance movement set based on the target song's sheet music information.

[0009] Determine the set of dance movement control instructions corresponding to the target set of dance movements, and send the set of dance movement control instructions to the robot;

[0010] The dance motion control instruction set is used for the robot to dance to a target song, where the target song is the song corresponding to the sheet music information of the target song.

[0011] According to an embodiment of the present invention, a method for controlling a robot to dance includes choreographing dance movements based on the target song's musical score information and the basic movement set, generating a target dance movement set based on the target song's musical score information, comprising:

[0012] Based on the target song's musical notation information and the set of basic actions, generate interactive question information;

[0013] First feedback information is obtained from the question-and-answer interaction.

[0014] Based on the first feedback information, target dance movements are generated for each musical beat corresponding to several lyrics in the target song's simplified musical score information.

[0015] Determine the set of target dance movements, which includes each of the target dance movements; each target dance movement belongs to the set of basic movements.

[0016] According to an embodiment of the present invention, a method for controlling a robot to dance is provided, wherein, based on the first feedback information, target dance movements are generated for each musical beat corresponding to several lyrics in the target song's musical score information, including:

[0017] If the first feedback information includes the user's desired dance style and music beat, determine several lyrics corresponding to each of the target music beats in the target song's sheet music information;

[0018] For each set of lyrics, based on the semantic information of the lyrics and the dance style, the dance movements that interpret the lyrics are inferred, and the inferred movement that best matches the semantic information and the dance style, and can be completed within the corresponding musical beat, is determined as the target dance movement; the at least one basic movement belongs to the set of basic movements.

[0019] According to an embodiment of the present invention, a method for controlling a robot to dance, after generating the target dance movement set containing the target song's musical score information, the method further includes:

[0020] Receive second feedback information from the user regarding the target dance movement set;

[0021] When the second feedback information indicates that the target dance movement set meets the preset requirements, the step of determining the set of dance movement control instructions corresponding to the target dance movement set is executed.

[0022] A method for controlling a robot to dance according to an embodiment of the present invention, the method further comprising:

[0023] If the second feedback information indicates that the target dance movement set does not meet the preset requirements, the process returns to the step of choreographing dance movements based on the target song score information and the basic movement set to generate the target dance movement set based on the target song score information; until the choreographed target dance movement set meets the preset requirements, the process of determining the dance movement control instruction set corresponding to the target dance movement set is executed.

[0024] A method for controlling a robot to dance according to an embodiment of the present invention, the method further comprising:

[0025] Receive modification instructions sent by the user; the modification instructions include instructions to modify at least one of the dance style and music rhythm of a preset portion of the simplified musical score information of the target song;

[0026] Based on the target song's sheet music information, the modification instructions, and the basic movement set, dance movements are choreographed to generate a target dance movement set based on the target song's sheet music information.

[0027] According to an embodiment of the present invention, a method for controlling a robot to dance includes the following process for obtaining the musical score information of a target song:

[0028] Receive basic information about the target song input by the user;

[0029] Based on the pre-stored mapping relationship between basic song information and simplified song musical notation information, the simplified song musical notation information corresponding to the basic song information is obtained.

[0030] The present invention also provides a device for controlling a robot to dance, comprising:

[0031] The information acquisition module is used to acquire the sheet music information of the target song and the set of basic actions supported by the robot;

[0032] The choreography module is used to choreograph dance movements based on the target song's sheet music information and the basic movement set, and generate a target dance movement set based on the target song's sheet music information.

[0033] The dance control module is used to determine the set of dance movement control instructions corresponding to the target set of dance movements, and send the set of dance movement control instructions to the robot;

[0034] The dance motion control instruction set is used for the robot to dance to a target song, where the target song is the song corresponding to the sheet music information of the target song.

[0035] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method of controlling a robot to dance as described above.

[0036] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method of controlling a robot to dance as described above.

[0037] The present invention provides a method, apparatus, electronic device, and storage medium for controlling a robot to dance. The method, implemented through the ChatGPT platform, involves choreographing dance movements based on the target song's musical score and a set of basic movements. This generates a target dance movement set based on the target song's musical score, which is then converted into a set of dance movement instructions and sent to the robot. This replaces the traditional method of relying solely on human intervention to choreograph dance movements. It solves the shortcomings of existing technologies where dancing robots must rely on human intervention to choreograph dance movements and the types of dances they can perform are limited and fixed. The invention achieves the goal of quickly choreographing dances for various songs for dancing robots without relying on human intervention, thereby significantly increasing the diversity and richness of dances that dancing robots can perform. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0039] Figure 1 This is a flowchart illustrating the method for controlling a robot to dance provided in an embodiment of the present invention;

[0040] Figure 2 This is a schematic diagram of the target song's musical notation information provided in an embodiment of the present invention;

[0041] Figure 3 This is a schematic diagram of the structure of the device for controlling a robot to dance provided in an embodiment of the present invention;

[0042] Figure 4 This is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention. Detailed Implementation

[0043] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0044] In embodiments of the present invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. In the textual description of the present invention, the character " / " generally indicates that the preceding and following related objects have an "or" relationship. Furthermore, it should be noted that the serial numbers assigned to the described objects in the present invention, such as "first," "second," etc., are only used to distinguish the described objects and do not have any sequential or technical meaning.

[0045] With the continuous development and advancement of science and technology, robots are becoming increasingly diverse. Besides robotic vacuum cleaners, food delivery robots, and courier robots, dancing robots that can dance in place of the user have also emerged. Dancing robots can not only fill the void and boredom of the elderly and satisfy the curiosity of teenagers and children, but also inspire people's understanding and reinvention of new technologies. Therefore, how to control a dancing robot to dance is particularly important.

[0046] In related technologies, before a dancing robot can dance, the user usually needs to choreograph a dance move for a song or a piece of music based on the movements supported by the dancing robot. After the choreographed dance move is converted into motion control commands that the dancing robot can recognize, the motion control commands are sent to the dancing robot so that the dancing robot can dance according to the motion control commands.

[0047] However, existing dancing robots can only dance dances that have been choreographed by the user. For new songs, the user still needs to choreograph the dance moves again. As a result, dancing robots have to rely on human factors to choreograph the dance moves so that they can only dance a limited and fixed variety of dances.

[0048] To address the aforementioned technical problems, embodiments of the present invention provide a method, apparatus, electronic device, and storage medium for controlling a robot to dance. The following describes the process in conjunction with... Figures 1-4 This invention describes a method, apparatus, electronic device, and storage medium for controlling a robot to dance. The execution entity of the method for controlling the robot to dance can be a ChatGenerative Pre-trained Transformer (ChatGPT) platform. The ChatGPT platform is a chatbot platform based on a pre-trained model, which can be used for language generation, dialogue system development, and customer service robots. The ChatGPT platform can employ Convolutional Neural Network (CNN) models and Transformer models, and pre-train a GPT-2 model. The ChatGPT platform can learn the grammar and context of different languages ​​and generate natural and fluent responses. The ChatGPT platform currently supports various application scenarios, such as intelligent customer service, product recommendation, website navigation, problem solving, etc. The ChatGPT platform can quickly and accurately search for relevant answers based on user input information to solve user problems. Meanwhile, the ChatGPT platform also possesses a certain learning capability, continuously learning from user questions and answers to better serve users. In terms of intelligent customer service, ChatGPT can automatically respond to user questions and provide recommendations and services based on user needs. Regarding problem-solving, ChatGPT can retrieve relevant solutions based on the information provided by the user and offer them accordingly. The Transformer model, a neural network model, learns context and thus meaning by tracking relationships in sequence data.

[0049] It should be noted that the ChatGPT platform can be located in an electronic device or a server. The electronic device can be a personal computer (PC), portable device, laptop, smartphone, tablet, portable wearable device, or other electronic devices. The server can refer to a single server, or a server cluster consisting of multiple servers, a cloud computing center, etc. This invention does not limit the specific form of the electronic device or server. This invention also does not specifically limit the specific form of the electronic device or server used to set up the ChatGPT platform.

[0050] Reference Figure 1 This is a flowchart illustrating the method for controlling a robot to dance provided in an embodiment of the present invention, as shown below. Figure 1 As shown, the method for controlling a robot to dance, applied to the ChatGPT platform that communicates with the robot, may include the following steps 110 to 130.

[0051] Step 110: Obtain the sheet music information of the target song and the set of basic actions supported by the robot.

[0052] The target song's sheet music information can be the sheet music information of the target song for which dance moves are to be choreographed. The target song's sheet music information can include, but is not limited to, the song title, tempo, key, key signature, lyrics, musical rhythm, singer, and the usernames corresponding to the lyricist, composer, and sheet music maker.

[0053] For example, refer to Figure 2 This is a schematic diagram of the musical notation information of the target song provided in an embodiment of the present invention. Figure 2 In the diagram, 1 = F 4 / 4 represents... Figure 2 The song shown is in the key of F and the time signature is 4 / 4, which means a quarter note is one beat and there are four beats in each measure. This indicates that the pitch of the note is C (do), and the pitch is 80 cents. In F major, F refers to fa, which is a fundamental note in the scale, specifically fa among the seven fundamental notes do, re, mi, fa, sol, la, and si.

[0054] Specifically, the ChatGPT platform obtains the target song's sheet music information and the robot's supported basic action set through user input. This input can be achieved through various methods, including, but not limited to, input on the ChatGPT platform, input via a terminal device application, voice input, and uploading photos. For example, it can be obtained by the user manually inputting the target song's sheet music information and basic action set onto the ChatGPT platform, by the user manually inputting the target song's sheet music information and basic action set into a terminal device application connected to the ChatGPT platform, by uploading a photograph containing the target song's sheet music information and basic action set for image recognition by the ChatGPT platform, or by the user or terminal device outputting the target song's sheet music information and basic action set via voice. No specific limitations are placed on the method by which the ChatGPT platform obtains the target song's sheet music information and basic action set.

[0055] It should be noted that the robot specifically refers to a dancing robot, which can be a humanoid robot used for conversation, dancing, object detection, obstacle avoidance, movement on wheels, and facial expressions. The basic set of movements supported by the dancing robot may include, but is not limited to, somersaults, handstands, Tai Chi, and group gymnastics. Furthermore, the set of supported basic movements will vary depending on the type of dancing robot. This invention does not impose any limitations on this.

[0056] Furthermore, it should be noted that simplified musical notation uses Arabic numerals to represent the seven basic notes of the scale, with the Arabic numeral 0 representing a rest, and dots above and below the notes to indicate high and low pitch. The notes in simplified musical notation are determined by the key signature and solfège syllables, belonging to the movable-do solfège system. In the melodic solfège system, the position and pitch of "do" can be moved and changed, but the notes of each key have fixed solfège syllables. For example, the first basic note in a major key is sung as "do," the second basic note as "re," and so on.

[0057] Step 120: Based on the target song's sheet music information and basic movement set, choreograph the dance movements to generate a target dance movement set based on the target song's sheet music information.

[0058] Specifically, as a chatbot platform based on a pre-trained model, ChatGPT not only facilitates language generation and dialogue system development but also possesses learning capabilities, continuously adapting to user needs to better serve them. Therefore, ChatGPT can choreograph dance moves based on the target song's sheet music and a set of basic movements. This involves learning the target song's sheet music to identify its genre, which could be hip-hop, rap, acapella, new age, bossa nova, reggae, ancient music, chinoiserie, or rhythm and blues (R&B). Then, based on the song's sheet music's beat, tempo, mode, and key signature, it selects target dance moves from the basic movement set that match the specified genre, tempo, mode, and key signature. These target dance moves, identified by a specific execution order, form the target dance move set. Each target dance move can correspond to a musical beat, and each target dance move includes at least one basic move from the set of basic moves. For example, each target dance basic move can be one basic move, two identical basic moves, or two different basic moves. No specific limitations are made here.

[0059] Step 130: Determine the set of dance movement control instructions corresponding to the target set of dance movements, and send the set of dance movement control instructions to the robot.

[0060] Among them, the dance motion control instruction set is used for the robot to dance to the target song, which is the song corresponding to the sheet music information of the target song.

[0061] Specifically, for the generated set of target dance moves, the ChatGPT platform can convert each target dance move into a corresponding dance movement control instruction. The execution order of each dance movement control instruction is the same as its corresponding target dance move, and each dance movement control instruction is a robot-recognizable control instruction. The set of dance movement control instructions, arranged in the execution order of the target dance moves in the set, is called the dance movement control instruction set. When the ChatGPT platform sends the dance movement control instruction set to the robot, the robot can dance to the target song by executing each dance movement control instruction.

[0062] The method for controlling a robot to dance provided in this invention uses the ChatGPT platform to choreograph dance movements based on the target song's musical score information and a set of basic movements. This generates a target dance movement set based on the target song's musical score information, and then converts the target dance movement set into a set of dance movement instructions before sending them to the robot. This replaces the traditional method that relies solely on human factors to choreograph dance movements. It solves the shortcomings of existing technologies where dancing robots must rely on human factors to choreograph dance movements before they can dance, and the types of dances they can dance are limited and fixed. This method achieves the goal of quickly choreographing dances for various songs for dancing robots without relying on human factors, thereby significantly improving the diversity and richness of the types of dances that dancing robots can dance.

[0063] Based on the above Figure 1 The method for controlling a robot to dance, as shown, in one example embodiment, includes the following steps in step 110: Obtaining the target song's musical score information.

[0064] First, the system receives basic information about the target song input by the user; then, based on the pre-stored mapping relationship between the basic song information and the song's sheet music information, it retrieves the sheet music information of the target song corresponding to the basic song information.

[0065] The basic information of the target song can be the basic information of the song for which dance moves are to be choreographed, including but not limited to the song title and / or singer. Furthermore, in the mapping relationship, each piece of basic song information includes the corresponding song title and / or singer, and each piece of sheet music information is the sheet music information for the corresponding song. That is, the mapping relationship can include the sheet music information of different songs sung by the same singer, the sheet music information of the same song sung by different singers, and possibly the sheet music information of different songs sung by the same singer.

[0066] Specifically, the ChatGPT platform receives and parses the basic information of the target song input by the user to determine if the basic information is the song title, the singer, or both. When the basic information is determined to be the song title, based on a mapping relationship, the sheet music information for all songs corresponding to that title can be determined. The platform can then ask the user questions and receive answers regarding each of these sheet music options to determine the target song's sheet music from the multiple options. Similarly, when the basic information is determined to be the singer, the platform can determine the sheet music information for all songs performed by that singer, again using the same method. Finally, when the basic information is determined to be both the song title and the singer, the platform can determine the sheet music information for songs that correspond to both the song title and the singer.

[0067] The method for controlling a robot to dance provided in this embodiment of the invention allows the ChatGPT platform to quickly and accurately obtain the target song's sheet music information corresponding to the target song's basic information by using the mapping relationship between the basic song information and the song's sheet music information. This can also effectively improve the convenience and practicality of choreographing dance moves.

[0068] Based on the above Figure 1 In one example embodiment of the method for controlling a robot to dance, step 120 may include the following specific implementation process:

[0069] First, based on the target song's sheet music information and the set of basic movements, interactive question information is generated; then, the first feedback information of the interactive question information is obtained; then, based on the first feedback information, target dance movements are generated for each musical beat in the target song's sheet music information, corresponding to several lyrics; a set of target dance movements is determined, including each target dance movement; each target dance movement belongs to the set of basic movements.

[0070] Specifically, when the ChatGPT platform obtains the sheet music information and basic movement set of a target song, it is uncertain about the user's needs. At this point, it can ask the user questions, i.e., generate interactive question information. This interactive question information can include asking the user about their needs and specific details related to those needs. When the ChatGPT platform outputs the generated interactive question information to the user, it can receive the user's first feedback information in response to the interactive question information. For example, if the ChatGPT platform asks "What are your needs?", the corresponding first feedback information could be "Choreograph a dance for the sheet music information of the target song"; if the ChatGPT platform asks "What kind of dance style do you like?", the corresponding first feedback information could be "I like Hip-hop". Furthermore, the ChatGPT platform can also ask "What key? What time signature do you want?", and the corresponding first feedback information could be "F major, 2 / 4 time and 4 / 4 time". The dance style can be one of the following: classical dance, ballet, folk dance, traditional folk dance, modern dance, tap dance, and jazz dance, etc. Street dance includes jazz dance and hip-hop.

[0071] At this point, based on the aforementioned first feedback information, the ChatGPT platform uses all the basic movements contained in the basic movement set as the movement space, and choreographs dance movements for several lyrics corresponding to each musical beat in the target song's sheet music information. That is, it infers suitable basic movements from the movement space to match several lyrics corresponding to each musical beat, thereby generating target dance movements for several lyrics corresponding to each musical beat in the target song's sheet music information; until a target dance movement set including each target dance movement is determined.

[0072] It should be noted that the ChatGPT platform can also pre-acquire the sheet music information of each song and its corresponding dance move set through the application of pre-trained models, so that when the sheet music information of a target song is subsequently obtained, the corresponding target dance move set can be quickly obtained. This invention does not specifically limit the method by which the ChatGPT platform obtains the target dance move set.

[0073] Furthermore, it's worth noting that in addition to receiving passive feedback from users through interactive question-and-answer sessions, the ChatGPT platform can also receive proactive feedback. For example, users can proactively provide feedback to the ChatGPT platform that the target dance moves are the same as those on the same musical beat and note. This ensures the speed of choreographing the target dance moves.

[0074] The method for controlling a robot to dance provided in this invention involves the ChatGPT platform obtaining first feedback information through question-and-answer interaction. This allows the platform to determine the user's choreography requirements and related details. Based on the first feedback information, target dance movements are generated for each musical beat in the target song's score, corresponding to several lyrics, until a target dance movement set is determined. In this way, by continuously learning from the user's questions and answers and reasoning about the dance movements, the ChatGPT platform eventually creates a target dance movement set that meets the user's choreography requirements, improving the flexibility and reliability of the ChatGPT platform's choreography.

[0075] Based on the above Figure 1 The method for controlling a robot to dance, as shown in one example embodiment, involves the ChatGPT platform generating target dance movements for each musical beat corresponding to several lyrics in the target song's musical score based on first feedback information. The specific implementation process may include:

[0076] First, given the user's desired dance style and music beat in the initial feedback information, determine the lyrics corresponding to each target music beat in the target song's sheet music. Then, for each set of lyrics, infer the dance moves that represent the lyrics based on the semantic information and dance style of the lyrics. The most inferred moves that best match the semantic information and dance style, along with at least one basic move that can be completed within the corresponding music beat, are determined as the target dance moves.

[0077] Among them, at least one basic action belongs to the set of basic actions.

[0078] Specifically, when the ChatGPT platform determines, based on the first feedback information, that the user's desired dance style is Hiphop and the music time signature is 2 / 4 or 4 / 4, it can identify several lyrics corresponding to each 2 / 4 time signature and several lyrics corresponding to each 4 / 4 time signature in the target song's sheet music. At this point, for each set of lyrics, the platform can infer the dance moves that correspond to the lyrics based on the semantic information and dance style of the lyrics. The dance move that best matches the semantic information and dance style, and can be completed within the corresponding music time signature, is identified as the target dance move.

[0079] The method for controlling a robot to dance provided in this invention utilizes the ChatGPT platform to generate target dance movements for each musical beat based on the dance style and semantic information of several lyrics corresponding to each musical beat. By combining the semantics of the lyrics and the dance style, a dance most closely matching the target song can be choreographed, improving the intelligence and reliability of the ChatGPT platform's choreography.

[0080] Based on the above Figure 1 In one example embodiment of the method for controlling a robot to dance, to better suit user needs, the choreography process on the ChatGPT platform can also receive user modification commands to re-choreograph the dance or modify specific parts of the choreography. Based on this, the method for controlling a robot to dance provided by the present invention may further include:

[0081] Receive modification instructions sent by the user; the modification instructions include instructions to modify at least one of the dance style and music rhythm of the preset part of the musical score information of the target song; choreograph the dance movements based on the musical score information of the target song, the modification instructions and the basic movement set, and generate the target dance movement set of the musical score information of the target song.

[0082] Specifically, during the choreography process on the ChatGPT platform, users can send modification commands to the platform via text input and / or voice input. These commands can modify the dance style and / or musical rhythm of at least one part of the target song's sheet music, including the first half, middle half, and second half. This allows the ChatGPT platform to combine the modification commands, the target song's sheet music, and the basic movement set to choreograph the dance moves, thereby generating a target dance movement set based on the target song's sheet music. For example, a specific modification command could be to change the dance style of the first half of the target musical score from Hip-hop to folk dance, and change the time signature of the first half from "2 / 4 and 4 / 4" to "3 / 4". Another specific modification command could be to change the dance style of the middle part of the target musical score from Hip-hop to modern dance, and change the time signature of the middle part from "2 / 4 and 4 / 4" to "3 / 4 and 4 / 4". A third specific modification command could be to change the dance style of the second half of the target musical score from Hip-hop to ballet, and change the time signature of the second half from "2 / 4 and 4 / 4" to "2 / 4 and 3 / 4". The modification commands can be any of these three types. No specific limitations are set here.

[0083] The method for controlling a robot to dance provided in this invention, through the ChatGPT platform, allows the robot to choreograph dance movements based on user instructions to modify at least one of the dance style and musical rhythm of a preset portion of the target song's sheet music, the target song's sheet music information, and a set of basic movements. This enables the robot to dance a song, performing a folk dance in the first half and a modern dance in the second half, or a modern dance for the entire song, or a folk dance for the entire song. This improves the diversity and flexibility of choreography on the ChatGPT platform.

[0084] Based on the above Figure 1 In one example embodiment of the method for controlling a robot to dance, to ensure that the choreography better meets the user's needs, the user can confirm the generated target dance movement set before converting it into motion control commands and issuing them to the robot. Based on this, after step 120, the method for controlling a robot to dance provided by the present invention may further include:

[0085] Receive second feedback information from the user regarding the target dance movement set; if the second feedback information indicates that the target dance movement set meets the preset requirements, execute the step of determining the set of dance movement control instructions corresponding to the target dance movement set.

[0086] Specifically, before the ChatGPT platform sends the generated set of target dance moves to the robot, it can first have the user confirm whether the set of target dance moves meets preset requirements. Preset requirements can represent the user's pre-defined maximum satisfaction with the target dance moves choreographed by the ChatGPT platform. When the ChatGPT platform receives second feedback from the user indicating that the set of target dance moves meets the preset requirements, it can proceed to step 130.

[0087] The method for controlling a robot to dance provided by this invention involves the ChatGPT platform receiving second feedback information from the user indicating that the target dance movement set meets preset requirements, and then executing the steps of converting the target dance movement set into a set of dance movement control instructions and issuing them to the robot. This ensures that the robot's dance more closely matches the user's actual needs.

[0088] Based on the above Figure 1 In one example embodiment of the method for controlling a robot to dance, as shown, the dance moves can be rearranged when the user is dissatisfied with the generated target dance move set. Based on this, after receiving second feedback information from the user regarding the target dance move set, the method for controlling a robot to dance provided by this invention may further include:

[0089] If the second feedback information indicates that the target dance movement set does not meet the preset requirements, the process returns to the step of choreographing dance movements based on the target song's sheet music information and the basic movement set to generate the target dance movement set based on the target song's sheet music information; until the choreographed target dance movement set meets the preset requirements, the process executes the step of determining the dance movement control instruction set corresponding to the target dance movement set.

[0090] Specifically, when the ChatGPT platform receives second feedback from the user indicating that the target dance move set does not meet the preset requirements, it can return to step 120 to re-choreograph the dance moves. This process continues until the choreographed target dance move set meets the preset requirements, at which point step 130 can be executed.

[0091] The method for controlling a robot to dance provided by this invention allows the ChatGPT platform to receive second feedback information from the user indicating that the target dance movement set does not meet the preset requirements. In this case, by rearranging the dance movements, it can be ensured that the dance performed by the robot is more in line with the user's actual needs.

[0092] The apparatus for controlling a robot to dance provided in the embodiments of this application will be described below. The apparatus for controlling a robot to dance described below can be referred to in correspondence with the method for controlling a robot to dance described above.

[0093] This invention provides a device for controlling a robot to dance, which is applied to the ChatGPT platform that communicates with the robot; see reference. Figure 3 This is a schematic diagram of the structure of the device for controlling a robot to dance provided in an embodiment of the present invention, as shown below. Figure 3 As shown, the device 300 for controlling the robot to dance may include an information acquisition module 310, a motion choreography module 320, and a dance control module 330.

[0094] The information acquisition module 310 is used to acquire the sheet music information of the target song and the set of basic actions supported by the robot.

[0095] The choreography module 320 is used to choreograph dance movements based on the target song's sheet music information and a set of basic movements, generating a target dance movement set based on the target song's sheet music information.

[0096] The dance control module 330 is used to determine the set of dance motion control instructions corresponding to the target set of dance motions and send the set of dance motion control instructions to the robot.

[0097] Among them, the dance motion control instruction set is used for the robot to dance to the target song, which is the song corresponding to the sheet music information of the target song.

[0098] Optionally, the motion choreography module 320 is specifically used to generate question interaction information based on the target song's sheet music information and the basic motion set; obtain the first feedback information of the question interaction information; generate target dance movements for several lyrics corresponding to each musical beat in the target song's sheet music information based on the first feedback information; determine the target dance movement set including each target dance movement; each target dance movement belongs to the basic motion set.

[0099] Optionally, the choreography module 320 is specifically used to determine, given the first feedback information including the user's desired dance style and music beat, several lyrics corresponding to each target music beat in the target song's sheet music; for each set of lyrics, to infer the dance movements that interpret the lyrics based on the semantic information and dance style of the lyrics, and to determine the most consistent with the semantic information and dance style, as well as at least one basic movement that can be completed within the corresponding music beat, as the target dance movement; at least one basic movement belongs to the basic movement set.

[0100] Optionally, the dance control module 330 can be used to receive second feedback information from the user regarding the target dance movement set; and, if the second feedback information indicates that the target dance movement set meets preset requirements, to execute the step of determining the set of dance movement control instructions corresponding to the target dance movement set.

[0101] Optionally, the dance control module 330 can also be used to return to the step of choreographing dance movements based on the target song's sheet music information and the basic movement set, and generating a target dance movement set based on the target song's sheet music information, when the second feedback information indicates that the target dance movement set does not meet the preset requirements; until the choreographed target dance movement set meets the preset requirements, the step of determining the dance movement control instruction set corresponding to the target dance movement set is executed.

[0102] Optionally, the choreography module 320 is further used to receive modification instructions sent by the user; the modification instructions include instructions to modify at least one of the dance style and music rhythm of the preset part of the simplified score information of the target song; and to choreograph dance movements based on the simplified score information of the target song, the modification instructions and the basic movement set to generate a target dance movement set based on the simplified score information of the target song.

[0103] Optionally, the information acquisition module 310 is specifically used to receive the basic information of the target song input by the user; and to acquire the target song's sheet music information corresponding to the basic information of the target song based on the pre-stored mapping relationship between the basic information of the song and the sheet music information.

[0104] The device 300 for controlling a robot to dance provided in this embodiment of the invention can execute the technical solution of the method for controlling a robot to dance in any of the above embodiments. Its implementation principle and beneficial effects are similar to those of the method for controlling a robot to dance, and can be found in the implementation principle and beneficial effects of the method for controlling a robot to dance, which will not be repeated here.

[0105] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4As shown, the electronic device 400 may include: a processor 410, a communication interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call logical instructions in the memory 430 to execute a method for controlling the robot to dance, the method including:

[0106] Obtain the target song's sheet music information and the robot's supported basic motion set; choreograph dance movements based on the target song's sheet music information and the basic motion set to generate a target dance movement set based on the target song's sheet music information; determine the dance movement control instruction set corresponding to the target dance movement set and send the dance movement control instruction set to the robot; wherein, the dance movement control instruction set is used for the robot to dance to the target song, and the target song is the song corresponding to the target song's sheet music information.

[0107] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0108] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program that can be stored on a non-transitory computer-readable storage medium, wherein when the computer program is executed by a processor, the computer is able to execute the method for controlling a robot to dance provided by the above methods, the method comprising:

[0109] Obtain the target song's sheet music information and the robot's supported basic motion set; choreograph dance movements based on the target song's sheet music information and the basic motion set to generate a target dance movement set based on the target song's sheet music information; determine the dance movement control instruction set corresponding to the target dance movement set and send the dance movement control instruction set to the robot; wherein, the dance movement control instruction set is used for the robot to dance to the target song, and the target song is the song corresponding to the target song's sheet music information.

[0110] In another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for controlling a robot to dance provided by the methods described above, the method comprising:

[0111] Obtain the target song's sheet music information and the robot's supported basic motion set; choreograph dance movements based on the target song's sheet music information and the basic motion set to generate a target dance movement set based on the target song's sheet music information; determine the dance movement control instruction set corresponding to the target dance movement set and send the dance movement control instruction set to the robot; wherein, the dance movement control instruction set is used for the robot to dance to the target song, and the target song is the song corresponding to the target song's sheet music information.

[0112] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0113] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0114] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for controlling a robot to dance, characterized in that, The method, applied to the ChatGPT platform for communication with robots, includes: Obtain the sheet music information of the target song and the set of basic actions supported by the robot; Based on the target song's sheet music information and the basic movement set, dance movements are choreographed to generate a target dance movement set based on the target song's sheet music information. Determine the set of dance movement control instructions corresponding to the target set of dance movements, and send the set of dance movement control instructions to the robot; The dance motion control instruction set is used for the robot to dance to a target song, where the target song is the song corresponding to the sheet music information of the target song. The step of choreographing dance movements based on the target song's sheet music information and the basic movement set to generate a target dance movement set based on the target song's sheet music information includes: Based on the target song's musical notation information and the set of basic actions, generate interactive question information; First feedback information is obtained from the question-and-answer interaction. Based on the first feedback information, target dance movements are generated for each musical beat corresponding to several lyrics in the target song's simplified musical score information. Determine the set of target dance movements, which includes each of the target dance movements; each target dance movement belongs to the set of basic movements; The step of generating target dance movements for each musical beat corresponding to several lyrics in the target song's simplified musical score information based on the first feedback information includes: If the first feedback information includes the user's desired dance style and music beat, determine the lyrics corresponding to each target music beat in the target song's sheet music information. For each set of lyrics, based on the semantic information of the lyrics and the dance style, the dance movements that interpret the lyrics are inferred, and the inferred movement that best matches the semantic information and the dance style, and can be completed within the corresponding musical beat, is determined as the target dance movement; the at least one basic movement belongs to the set of basic movements.

2. The method for controlling a robot to dance according to claim 1, characterized in that, After generating the target dance movement set containing the target song's sheet music information, the method further includes: Receive second feedback information from the user regarding the target dance movement set; When the second feedback information indicates that the target dance movement set meets the preset requirements, the step of determining the set of dance movement control instructions corresponding to the target dance movement set is executed.

3. The method for controlling a robot to dance according to claim 2, characterized in that, The method further includes: If the second feedback information indicates that the target dance movement set does not meet the preset requirements, the process returns to the step of choreographing dance movements based on the target song score information and the basic movement set to generate the target dance movement set based on the target song score information; until the choreographed target dance movement set meets the preset requirements, the process of determining the dance movement control instruction set corresponding to the target dance movement set is executed.

4. The method for controlling a robot to dance according to claim 1, characterized in that, The method further includes: Receive modification instructions sent by the user; the modification instructions include instructions to modify at least one of the dance style and music rhythm of a preset portion of the simplified musical score information of the target song; Based on the target song's sheet music information, the modification instructions, and the basic movement set, dance movements are choreographed to generate a target dance movement set based on the target song's sheet music information.

5. The method for controlling a robot to dance according to claim 1, characterized in that, The process of obtaining the musical notation information of the target song includes: Receive basic information about the target song input by the user; Based on the pre-stored mapping relationship between basic song information and simplified song musical notation information, the simplified song musical notation information corresponding to the basic song information is obtained.

6. A device for controlling a robot to dance, characterized in that, The device is used in the ChatGPT platform for communicating with robots, and includes: The information acquisition module is used to acquire the sheet music information of the target song and the set of basic actions supported by the robot; The choreography module is used to choreograph dance movements based on the target song's sheet music information and the basic movement set, and generate a target dance movement set based on the target song's sheet music information. The dance control module is used to determine the set of dance movement control instructions corresponding to the target set of dance movements, and send the set of dance movement control instructions to the robot; The dance motion control instruction set is used for the robot to dance to a target song, where the target song is the song corresponding to the sheet music information of the target song. The action programming module is specifically used for: Based on the target song's musical notation information and the set of basic actions, generate interactive question information; First feedback information is obtained from the question-and-answer interaction. If the first feedback information includes the user's desired dance style and music beat, determine the lyrics corresponding to each target music beat in the target song's sheet music information. For each set of lyrics, based on the semantic information of the lyrics and the dance style, the dance movements for interpreting the lyrics are inferred, and the inferred movement that best matches the semantic information and the dance style, and can be completed within the corresponding musical beat, is determined as the target dance movement; the at least one basic movement belongs to the set of basic movements. Determine the set of target dance movements, which includes each of the target dance movements; each target dance movement belongs to the set of basic movements.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method for controlling a robot to dance as described in any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the method for controlling a robot to dance as described in any one of claims 1 to 5.

Images