Dance data processing method, device and dance equipment
By playing music on the dance machine and collecting the user's footsteps and body movement data, combined with the calculation of overlapping area and matching degree, an accurate assessment of dance level is achieved, which solves the problem of inaccurate scoring in existing technologies and improves the experience and dissemination effect of dance games.
Patent Information
- Application Number
- CN202111306854.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-05
- Publication Date
- 2025-09-12
- Estimated Expiration
- 2041-11-05
AI Technical Summary
Existing dance machines cannot objectively reflect the degree of match between music and dance when scoring dance games. The scoring granularity is insufficient, resulting in large errors in the judgment of players' dance skills.
The music content of the dance game is played on a display device to obtain the beat points, and the motion capture device is used to collect the user's footstep movement data. The overlapping area data of the footsteps is calculated to determine the score value. Combined with the limb movement data captured by the camera and the virtual dance animation, an accurate assessment of the user's dance level can be achieved.
It improves the accuracy of dance game scoring, reduces evaluation errors, and promotes the widespread dissemination and sharing of dance games.
Smart Images

Figure CN114028819B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a dance data processing method, device, dance equipment, computer equipment, and computer storage medium. Background Art
[0002] With the popularity of dance machines, they are used for dance games in many scenarios. Dance machines collect footstep data through pedals, and then make corresponding score judgments to achieve somatosensory game interaction. Players can use dance games to entertain, relieve stress, and lose weight.
[0003] Existing dance machines generally use pedal data and reference data to judge when scoring dance games. Points are awarded when the user's pedal movements are consistent with the order of the footsteps. This scoring method cannot objectively reflect the degree of match between music and dance, and the scoring granularity is also insufficient. For most players, it is difficult to correctly judge the player's dance level, and the error is large. Summary of the Invention
[0004] In order to solve one of the above technical defects, the present application provides a dance data processing method, device, dance equipment, computer equipment and computer storage medium, which can improve data processing accuracy and reduce evaluation errors.
[0005] A dance data processing method, comprising:
[0006] Playing the music content of the dance game to the user through the display device and obtaining the beat points of the music content;
[0007] At each beat point of the music content, a motion capture device is used to collect footstep movement data generated by the user playing the dance game;
[0008] Calculating overlapping area data of the footsteps according to the footstep action data, and calculating a score value corresponding to each footstep action data according to the overlapping area data;
[0009] The evaluation data of the user on the dance game is determined according to the score value of each step action data.
[0010] In one embodiment, calculating the overlapping area data of the footsteps according to the footstep action data, and calculating the score value corresponding to each footstep action data according to the overlapping area data, includes:
[0011] Obtaining a scoring effective area of the motion capture device;
[0012] Reading the stepping area detected by the motion capture device;
[0013] Calculating a first area of the stepped area and a second area corresponding to the scoring effective area, and calculating a ratio of overlapping areas of footsteps based on the first area and the second area;
[0014] The user's rating value is determined based on the overlap area ratio and a preset evaluation level range.
[0015] In one embodiment, the dance data processing method further includes:
[0016] Get the dance instructional video selected by the user;
[0017] Extracting a thumbnail of each dance move from the dance instructional video;
[0018] A thumbnail of each dance move is displayed to the user.
[0019] In one embodiment, the dance data processing method, during the thumbnail indication process of the dance movements, further comprises:
[0020] Capture the user's body movement data through a camera;
[0021] Calculating the matching degree between the body movement data and the beat points, and determining the score value corresponding to each body movement according to the matching degree;
[0022] The evaluation data of the user on the dance game is calculated according to the score value of each footstep action data and the score value corresponding to each body action.
[0023] In one embodiment, the dance data processing method further includes:
[0024] capturing image data of the user performing the dance game through a camera;
[0025] Acquire the skeleton motion trajectory and three-dimensional skeleton data of the user's dance game according to the image data;
[0026] The three-dimensional skeleton data is rendered into a virtual dance animation of a set virtual character and output to a display device for synchronous display.
[0027] In one embodiment, the dance data processing method further includes:
[0028] Send PK links of dance games to multiple clients;
[0029] Receiving invitation requests from multiple clients in response to the PK link, and establishing a multi-person dance PK game scene between the clients;
[0030] Select the music content of the dance game, play it to users on each client, and start the dance game PK.
[0031] In one embodiment, the dance data processing method further includes:
[0032] Set up the user's dance game exercise plan;
[0033] During the dance game, obtain the motion parameters detected by the user's paired armband;
[0034] Calculate the user's dance heart rate and energy consumption value in real time based on the motion parameters and calculate the exercise duration;
[0035] The exercise plan is updated using the exercise heart rate, energy consumption value and exercise duration.
[0036] In one embodiment, the dance data processing method further includes:
[0037] determining virtual reward data based on the evaluation data;
[0038] Transferring a corresponding amount of virtual assets to the user according to the virtual reward data, and displaying the virtual assets through the display device;
[0039] The user is unlocked the right to use the music content according to the virtual asset, and the unlocked music content is added to the user's personal account.
[0040] A dance data processing device, comprising:
[0041] A playback module, configured to play the music content of the dance game to the user via a display device and obtain the beat points of the music content;
[0042] A collection module, configured to collect footstep movement data generated by a user playing a dance game at each beat point of the music content through a motion capture device;
[0043] a calculation module, configured to calculate overlapping area data of the footsteps according to the footstep action data, and calculate a score value corresponding to each footstep action data according to the overlapping area data;
[0044] The processing module is used to determine the evaluation data of the user in the dance game according to the score value of each footstep action data.
[0045] A dancing device comprises: a main control board, a motion capture device, an arm ring, and a camera; wherein the main control board is used to execute the steps of the above-mentioned dance data processing method.
[0046] A computer device comprising:
[0047] one or more processors;
[0048] Memory;
[0049] One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the above dance data processing method.
[0050] A computer-readable storage medium stores at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, at least one program, the code set, or the instruction set is loaded by the processor and executes the above-mentioned dance data processing method.
[0051] The technical solution of the present application plays the music content of a dance game to the user through a display device, obtains the beat points of the music content and collects the footstep movement data generated by the user when playing the dance game through a motion capture device at each beat point position, calculates the overlapping area data of the footsteps based on the footstep movement data to calculate the scoring value corresponding to each footstep movement data; finally, the user's evaluation data of the dance game is obtained according to the scoring value of each footstep movement data; this technical solution can correctly judge the player's dance level, reduce evaluation errors, and promote the widespread dissemination and sharing of dance games. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0053] Figure 1 It is a diagram of the application environment of the dance data processing method;
[0054] Figure 2 It is a schematic diagram of the structure of the dancing equipment;
[0055] Figure 3 is a flow chart of a dance data processing method according to an embodiment;
[0056] Figure 4 This is a diagram of the arrow interface of the dance game;
[0057] Figure 5 It is a flow chart for calculating the rating value;
[0058] Figure 6 is a flow chart of a dance data processing method according to another embodiment;
[0059] Figure 7-8 This is an example of a PK connection interface diagram;
[0060] Figure 9 is a structural diagram of a dance data processing device according to an embodiment;
[0061] Figure 10 This is a circuit diagram of a dancing device. DETAILED DESCRIPTION
[0062] The following describes in detail embodiments of the present application, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and are not to be construed as limiting the present application.
[0063] Those skilled in the art will understand that, unless otherwise stated, the singular forms "a," "an," "the," and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of this application refers to the presence of the stated features, integers, steps, and operations, but does not preclude the presence or addition of one or more other features, integers, steps, and operations.
[0064] refer to Figure 1 As shown, Figure 1 This is a diagram of the application environment of the dance data processing method. The technical solution can be applied to a dance device (mirror). Each user can use the dance device to play dance games and entertainment exercises. The dance device can be connected to the server through the network and can interact with the dance devices logged in by other users; of course, as an implementation environment of the dance data processing method, it can also be implemented on the server.
[0065] For dance equipment, refer to Figure 2 , Figure 2 This is a schematic diagram of the structure of a dance device, which is mainly composed of a main control board (not shown in the figure), a camera, a motion capture device (a dance mat, a dance pedal), an armband worn by the user (including sensors), and a display device (such as a touch screen). Figure 2 As shown, the user can play a dance game on the motion capture device. The main control board of the dance device can obtain image data and footstep movement data of the user during the dance game through the camera and the motion capture device. On the display device, virtual dance animation can be simulated through a virtual character image.
[0066] The following describes an embodiment of the dance data processing method of the present application by taking a dance pedal as an example. In this embodiment, reference is made to Figure 3 As shown, Figure 3 The present invention is a flow chart of a dance data processing method according to an embodiment, comprising:
[0067] Step S10: Play the music content of the dance game to the user via a display device, and obtain the beat points of the music content.
[0068] like Figure 2As shown, the user uses the dance device to play a dance game and can dance on the dance pedal. The display device can display the dance song and footsteps, etc., and can play the music content of the song at the same time. At this time, the dance device extracts the beat points of the music content of the song, generates beat auxiliary lines, etc., and displays them on the display interface to assist the user in dancing.
[0069] Step S20: At each beat point of the music content, a motion capture device is used to collect footstep movement data generated by the user playing the dance game.
[0070] The user dances on the dance pedal under the guidance of the beat point auxiliary lines and footsteps. The corresponding dance pedal can collect the user's footstep movement data. Through real-time footstep movement data collection, it is processed by the algorithm set on the dance device or transmitted to the server for processing.
[0071] like Figure 4 As shown, Figure 4 This is a schematic diagram of the arrow interface of a dance game. Taking a five-key dance pedal as an example, after the dance game starts, the user moves the moving arrow from bottom to top with the help of music. When the moving arrow moves to the beat point on the display area and coincides with the arrow of the beat point that needs to be judged, the user needs to make an action at the beat point. The user only needs to complete the dance steps by stepping on the arrow of the key area corresponding to the dance pedal.
[0072] Step S30 , calculating the overlapping area data of the footsteps according to the footstep action data, and calculating the score value corresponding to each footstep action data according to the overlapping area data.
[0073] In this step, after reaching the beat point in the dance game, the user needs to perform a stepping operation so that the arrow on the key area is consistent with the footsteps displayed on the interface. Therefore, based on the footstep action data, it is determined whether the action of the dance pedal stepped by the user corresponds to the beat point position, and the area of the key area stepped on is overlapped with the area size of the key area to calculate the score value.
[0074] In one embodiment, during this process, since the actual stepping position may not be correctly detected when the pressure sensor of the dance pedal is used for detection, in order to further improve the accuracy of the calculated score value, the real-time video image can be integrated and judged.
[0075] Based on this, the video image of the user's dance game is captured by a camera, and the human skeleton movement data corresponding to the beat point position is extracted from the video image; combined with the angle parameters between the user's various limbs relative to the preset human skeleton basic template, the key area that the user actually stepped on in the dance game is calculated.
[0076] Specifically, the pre-trained three-dimensional motion data model of the human skeleton can be used to predict the video image to obtain the three-dimensional coordinate value of the human skeleton motion data on each frame of the picture, and calculate the angle between the user's specified bone point and the bone point corresponding to the preset human skeleton basic template; calculate the cosine value based on the angle to determine the key position of the user on the dance pedal.
[0077] The technical solution of the above embodiment combines dance pedal detection and video image analysis to comprehensively calculate the user's evaluation data of the dance game; thereby, the player's dance level can be judged more accurately and the evaluation error is reduced.
[0078] In one embodiment, for the method of calculating the score value in step S30, refer to Figure 5 As shown, Figure 5 This is a flow chart for calculating the rating value, including the following:
[0079] S31, obtaining the effective scoring area of the motion capture device; specifically, the effective scoring area range corresponding to each key area on the dance pedal can be determined first, and the effective scoring area can be set according to the difficulty, thereby achieving the setting of scores of different difficulty levels.
[0080] S32, reading the stepping area detected by the motion capture device; specifically, the stepping range and pressure value can be detected by the pressure sensor of the dance pedal.
[0081] S33, calculating a first area of the stepped area and a second area corresponding to the scoring effective area, and calculating the overlapping area ratio of the footsteps based on the first area and the second area; specifically, using the overlapping ratio as a reference data for scoring.
[0082] S34, determining the user's rating value according to the overlapped area ratio and the preset evaluation level range; specifically, the user's rating value may be determined by the ratio value corresponding to the preset evaluation level range.
[0083] Preferably, the score of the dance action can be calculated based on the area where the stepped area overlaps with the key area. Preferably, the score can be graded, for example, the score can be perfect, good, cool, or miss.
[0084] Step S4: obtaining the user's evaluation data on the dance game according to the score values of the respective footstep movement data.
[0085] The scoring value is calculated by the data of each footstep action. After a song is finished, the scoring values of all the user's footstep actions are used to calculate the scoring data of the user's dance game for the entire song through the corresponding calculation formula. Preferably, the scoring level can be obtained based on the calculation result; for example, the evaluation level can be set to F, D, C, B, A, S, SS, SSS and other levels.
[0086] Based on the technical solutions of the above embodiments, the music content of the dance game is played to the user through the display device, the beat points of the music content are obtained, and the footstep movement data generated by the user playing the dance game is collected through the motion capture device at each beat point. The overlapping area data of the footsteps is calculated based on the footstep movement data to calculate the scoring value corresponding to each footstep movement data; finally, the user's evaluation data of the dance game is obtained according to the scoring value of each footstep movement data; the player's dance level can be correctly judged, the evaluation error is reduced, and the wide dissemination and sharing of the dance game is promoted.
[0087] In order to make the technical solution of this application clearer, it is further described below with reference to embodiments.
[0088] In one embodiment, reference Figure 6 As shown, Figure 6 FIG. 4 is a flow chart of a dance data processing method according to another embodiment, which may further include the following steps after step S40:
[0089] s1, obtaining the dance teaching video selected by the user; specifically, displaying the dance teaching video through the interface of the display device.
[0090] s2, extracting thumbnails of dance movements from the dance teaching video; specifically, extracting thumbnails of dance movements corresponding to key frames.
[0091] s3, during the thumbnail indication process of the dance action, the user's body movement data is captured by a camera; wherein, Figure 2 In the game, thumbnails of dance moves can be played in real time on the display device interface to provide users with dance move guidance. Under the guidance, users can play the dance game. At this time, the dance device can capture the user's video in real time through the camera and calculate the user's body movement data through the video.
[0092] s4, calculate the matching degree between the body movement data and the beat points, and determine the scoring value corresponding to each body movement according to the matching degree; specifically, the matching degree between the body movement data and the beat points is used to score and judge the body movements of the user in the dance game.
[0093] s5, calculating the user's evaluation data of the dance game according to the score values of each footstep action data and the score values corresponding to each body movement.
[0094] Specifically, the evaluation data of the user in the dance game is calculated by combining the score values of each footwork action data and the score values corresponding to each body movement; thereby, the player's dance level can be judged more accurately.
[0095] Based on the above technical solution, in the application, users can choose their favorite dance to play a dance game. The game displays the body movements that the user needs to perform at each beat point through thumbnails. The camera collects and determines the score of the user's body movements in real time, and combines the action score of the foot score to determine the user's score data in the dance game, thereby more accurately reflecting the user's dance level.
[0096] In one embodiment, in order to enhance the visualization effect, the dance data processing method of the present application may further include:
[0097] The image data of the user performing the dance game is captured by a camera; the skeletal motion trajectory and three-dimensional skeletal data of the user's dance game are obtained based on the image data; the three-dimensional skeletal data is rendered into a virtual dance animation of a set virtual character and output to a display device for synchronous display.
[0098] Specifically, through the display screen, the competition scenes and real-time rankings in the dance game can be played in real time. Based on 3D skeleton technology, the real-time live scenes can be converted into virtual stage 3D character scenes for display. While ensuring the personal privacy of the participating players, the dance game movements can be displayed in real time and synchronously to achieve a live broadcast effect.
[0099] In one embodiment, in order to better compare the scoring data between players, the dance data processing method of the present application may also include an online PK solution, as follows:
[0100] Sending a PK link of a dance game to multiple clients; receiving invitation requests from multiple clients in response to the PK link, establishing a multi-person dance PK game scene between the clients; selecting music content of the dance game, and playing it to users on each client, and starting the dance game PK.
[0101] For example, users can use the mini program to initiate a game challenge to friends or nearby strangers. After the other party accepts, they will start their respective dance game competitions. During this process, the dance game scoring data will be calculated and compared and sorted by the server, and then distributed to each client for display, so that the winner is determined by the scoring data. Users can interact with the server through voice during the online PK to enhance the application experience.
[0102] In one embodiment, in order to enhance the fitness benefits of dance games, the dance data processing method of the present application may further include:
[0103] Set up an exercise plan for the user's dance game; during the dance game, obtain the exercise parameters detected by the user's paired armband; calculate the user's dance heart rate and energy consumption value in real time based on the exercise parameters and count the exercise duration; use the exercise heart rate, energy consumption value and exercise duration to update the exercise plan.
[0104] The technical solution of the above embodiment calculates real-time data (calorie consumption, real-time exercise heart rate, exercise duration) through the equipped external armband, so that players can monitor their daily exercise consumption data, thereby providing important data reference for their fitness effect evaluation.
[0105] In one embodiment, in order to encourage users to be more involved in the dance game, the dance data processing method of the present application may further include:
[0106] Determine virtual reward data based on the evaluation data; transfer a corresponding amount of virtual assets to the user based on the virtual reward data, and display the virtual assets on the display device. Additionally, unlock music content usage rights for the user based on the virtual assets; and add the unlocked music content to the user's personal account.
[0107] The technical solution of the above embodiment can reward users with virtual currency, props, etc. Virtual currency includes gold coins, which can also be used to unlock certain songs and purchase other virtual props in the mall (such as character clothing and costumes). Props also include gold coin cards, etc. Rewards can be configured with different reward props according to different gameplay methods.
[0108] The dance data processing method provided in this application can be applied to a variety of dance games to process relevant data to achieve more accurate evaluation and improve the dance game effect.
[0109] For example, players can log in to the dance device by scanning the QR code through the on-demand mini program, register user information, select a character to create and activate the dance device, and choose their favorite dance game to play. The dance device will evaluate and process the relevant data detected to obtain accurate evaluation data.
[0110] For example, the system can customize diverse dance games based on players' personal preferences, such as E-Dance Fame, Master Apprentice, Food Challenge, Continuous Challenge, Boxing Master, Online PK Interaction, and Love Pet. For example, in E-Dance Fame, users can select their favorite songs to play a dance game. The game requires users to perform corresponding footsteps on the dance pedals at the corresponding beats. The dance equipment system determines the scoring data for the footsteps and transfers corresponding virtual asset rewards based on the scoring data. Virtual asset rewards include virtual currency and props. Rewards can also include access to certain songs in the dance game, or they can purchase other virtual props in the virtual mall, such as character clothing and costumes.
[0111] In addition, users can choose their favorite dance to play the game. In the game, thumbnails of the dance moves are displayed at each beat point through video images. Users make corresponding body movements during the dance game. The user's scoring data is obtained through the above technical solution and corresponding rewards are configured.
[0112] For example, users can select multiple songs to form a playlist and establish fitness goals for a dance game. Users need to dance the dances corresponding to these songs continuously. The user's rating data is obtained through the above technical solution, and when the rating data meets certain conditions, corresponding rewards are configured.
[0113] Furthermore, after starting the dance game, a virtual character is used to teach the user to perform boxing exercises, including straight punches, uppercuts, dodging and other dance operations. The user's scoring data is obtained through the above technical solution, and when the scoring data meets certain conditions, corresponding rewards are configured.
[0114] For example, players can choose a multiplayer competitive dance game, refer to Figure 7-8 As shown, Figure 7-8 This is an example of a connection PK interface diagram, where: Figure 7 This is a diagram of the connection invitation process. Figure 8 This is a schematic diagram of the PK process, which mainly includes the following:
[0115] (1) The user logs in to the dance device through face recognition / WeChat code scanning;
[0116] (2) Select a specific playlist to start online PK;
[0117] (3) Challenge friends or nearby strangers to a game through the mini program. After the other party accepts, they begin their respective dance game competitions.
[0118] (4) During the PK process, the AI camera recognizes the posture and the score data of each player is displayed on the leaderboard in real time; at the same time, the game situation is broadcasted by voice, and the scene is filmed in real time or displayed using the 3D character image of the virtual stage through 3D skeleton technology;
[0119] (5) The above technical solution is used to obtain the user's rating data and determine the winner, configure the corresponding rewards, and support sharing the results with friends with one click.
[0120] An embodiment of the dance data processing device will be described below.
[0121] refer to Figure 9 , Figure 9 FIG. 1 is a schematic structural diagram of a dance data processing device according to an embodiment, comprising:
[0122] The playing module 10 is used to play the music content of the dance game to the user through the display device and obtain the beat points of the music content;
[0123] The collection module 20 is used to collect footstep movement data generated by the user playing the dance game at each beat point of the music content through a motion capture device;
[0124] a calculation module 30 for calculating overlapping area data of the footsteps based on the footstep motion data, and calculating a score value corresponding to each footstep motion data based on the overlapping area data;
[0125] The processing module 40 is configured to determine the evaluation data of the user in the dance game according to the score values of the individual footstep movement data.
[0126] The dance data processing device of this embodiment can execute a dance data processing method provided in the embodiments of the present application. The implementation principles are similar. The actions performed by each module in the dance data processing device in each embodiment of the present application correspond to the steps in the dance data processing method in each embodiment of the present application. For the detailed functional description of each module in the dance data processing device, please refer to the description of the corresponding dance data processing method shown in the previous text, and will not be repeated here.
[0127] The following describes an embodiment of the dance device of the present application, with reference to Figure 10 As shown, Figure 10 This is a circuit diagram of a dance device, comprising a main control board, dance pedals, armbands, and a camera. The main control board is used to execute the steps of the dance movement auxiliary generation method described in the above embodiment. Furthermore, the dance device can be connected to a display device and an audio device to implement audio-visual playback functions, and can also be connected to a remote control to implement control functions.
[0128] An embodiment of a computer device of the present application is described below. The computer device includes:
[0129] one or more processors;
[0130] Memory;
[0131] One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the dance data processing method according to any of the above embodiments.
[0132] The following describes an embodiment of a computer-readable storage medium of the present application. The storage medium stores at least one instruction, at least one program, a code set, or an instruction set. The at least one instruction, at least one program, the code set, or the instruction set is loaded by the processor and executes the dance data processing method of any of the above-mentioned embodiments.
[0133] The dance device, computer device and computer-readable storage medium of the above-mentioned embodiment play the music content of the dance game to the user through the display device, obtain the beat points of the music content and collect the footstep movement data generated by the user when playing the dance game through the motion capture device at each beat point position, calculate the overlapping area data of the footsteps based on the footstep movement data to calculate the score value corresponding to each footstep movement data; finally, the user's evaluation data of the dance game is obtained according to the score value of each footstep movement data; this technical solution can correctly judge the player's dance level, reduce evaluation errors, and promote the widespread dissemination and sharing of dance games.
[0134] The above description is only part of the implementation methods of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A dance data processing method, characterized in that: include: Playing the music content of the dance game to the user through the display device and obtaining the beat points of the music content; At each beat point of the music content, a motion capture device is used to collect footstep movement data generated by the user playing the dance game; Calculating overlapping area data of the footsteps based on the footstep motion data, and calculating a score value corresponding to each footstep motion data based on the overlapping area data; comprising: obtaining a score effective area of the motion capture device; reading a stepping area detected by the motion capture device; calculating a first area of the stepping area and a second area corresponding to the score effective area, calculating an overlapping area ratio of the footsteps based on the first area and the second area; and determining a score value of the user based on the overlapping area ratio and a preset evaluation level range; The evaluation data of the user on the dance game is determined according to the score value of each step action data.
2. The dance data processing method according to claim 1, characterized in that: Also includes: Get the dance instructional video selected by the user; Extracting a thumbnail of each dance move from the dance instructional video; A thumbnail of each dance move is displayed to the user.
3. The dance data processing method according to claim 2, characterized in that: The thumbnail indication process of the dance action further includes: Capture the user's body movement data through a camera; Calculating the matching degree between the body movement data and the beat points, and determining the score value corresponding to each body movement according to the matching degree; The evaluation data of the user on the dance game is calculated according to the score value of each footstep action data and the score value corresponding to each body action.
4. The dance data processing method according to claim 1, wherein: Also includes: capturing image data of the user performing the dance game through a camera; Acquire the skeleton motion trajectory and three-dimensional skeleton data of the user's dance game according to the image data; The three-dimensional skeleton data is rendered into a virtual dance animation of a set virtual character and output to a display device for synchronous display.
5. The dance data processing method according to claim 1, characterized in that: Also includes: Send PK links of dance games to multiple clients; Receiving invitation requests from multiple clients in response to the PK link, and establishing a multi-person dance PK game scene between the clients; Select the music content of the dance game, play it to users on each client, and start the dance game PK.
6. The dance data processing method according to claim 1, characterized in that: Also includes: Set up the user's dance game exercise plan; During the dance game, obtain the motion parameters detected by the user's paired armband; Calculate the user's dance heart rate and energy consumption value in real time based on the motion parameters and calculate the exercise duration; The exercise plan is updated using the exercise heart rate, energy consumption value and exercise duration.
7. The dance data processing method according to any one of claims 1 to 6, characterized in that: Also includes: determining virtual reward data based on the evaluation data; Transferring a corresponding amount of virtual assets to the user according to the virtual reward data, and displaying the virtual assets through the display device; The user is unlocked the right to use the music content according to the virtual asset, and the unlocked music content is added to the user's personal account.
8. A dance data processing device, characterized in that: include: A playback module, configured to play the music content of the dance game to the user via a display device and obtain the beat points of the music content; A collection module, configured to collect footstep movement data generated by a user playing a dance game at each beat point of the music content through a motion capture device; A calculation module is configured to calculate overlapping area data of the footsteps based on the footstep motion data, and calculate a score value corresponding to each footstep motion data based on the overlapping area data; the calculation module comprises: obtaining a scoring effective area of the motion capture device; reading a stepping area detected by the motion capture device; calculating a first area of the stepping area and a second area corresponding to the scoring effective area, calculating an overlapping area ratio of the footsteps based on the first area and the second area; and determining a score value of the user based on the overlapping area ratio and a preset evaluation level range; The processing module is used to determine the evaluation data of the user in the dance game according to the score value of each footstep action data.
9. A dancing device, characterized in that: include: A main control board, a motion capture device, an armband, and a camera; wherein the main control board is used to execute the steps of the dance data processing method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Video generation method and device and electronic equipment
CN107920269A
An interaction method and system based on panoramic limb actions
CN109447020A
Video generating method and device, equipment and storage medium
CN109621425A
Dance machine and pedal thereof
CN209361838U