A monitoring and correction system and method for group dance movements

Abstract

The application discloses a kind of monitoring system and method for dance action correction, it is related to data monitoring technical field.The application includes: the action of different station dancers is collected by wearing device, each action includes multiple joint points and the three-dimensional space position of each joint point;Different station dancers are divided into different classes according to three-dimensional space position, and the dance action performed by dancers of the same class is the same;According to the three-dimensional space position of the joint point corresponding to the same joint of the dancers of the same class, curve fitting is carried out, the space position of each joint point is corrected according to the curve fitting result, and a standard dance action is obtained;Actual dance action is collected by wearing device, and action deviation is obtained by comparing standard dance action and actual action;According to action deviation, output action correction result at time T.

Description

Technical Field

[0001] This application relates to the field of motion capture technology, and in particular to a monitoring system and method for correcting dance movements. Background Technology

[0002] Group dance, as an art form where multiple dancers perform the same dance simultaneously, ensures that each dancer's movements and rhythm are completely synchronized throughout the performance, showcasing a harmonious artistic effect. Traditional group dance rehearsals rely on the instructor's visual observation and verbal guidance. During rehearsals, the instructor observes the overall performance of the group dance and individual movement deviations through real-time observation or video playback, then provides verbal feedback or posture guidance. With the development and maturity of wearable devices, correcting dance movements using wearable devices is becoming increasingly common.

[0003] In the prior art, Chinese patent CN116824702A discloses an intelligent wearable monitoring system for human posture in dance. This system analyzes the dwell time of the user's dance posture and judges the relationship between it and the dwell time of the standard dance posture in order to determine whether the user's dance posture changes too quickly or too slowly during the dance.

[0004] However, because the movements of each dancer in a group dance are not entirely consistent at certain times, and because different dancers have different understandings of dance techniques or musicality, there are differences in how they perform different dance movements. This results in a lack of uniformity in the collected standard movements, which leads to the final rehearsal effect failing to achieve the expected neatness and coordination. Summary of the Invention

[0005] Therefore, in order to solve the technical problem that existing technologies lack uniformity in the standard dance movements obtained during group dance rehearsals, this specification provides a monitoring system and method for correcting dance movements.

[0006] The following technical solution is adopted in this specification:

[0007] This specification provides a monitoring and correction system for group dance movements, including a central controller and several wearable devices for capturing dance movements; the central controller includes:

[0008] The dance movement acquisition module is used to collect the dance movements of dancers at different positions at time T using wearable devices, where T>>0; each dance movement includes multiple joints and the three-dimensional spatial position of each joint, and the joints correspond one-to-one with the dancer's joints;

[0009] The dance movement adjustment module is used to classify dancers in different positions into different categories based on their three-dimensional spatial positions. Dancers of the same category perform the same dance movements at time T. Based on the three-dimensional spatial positions of the joints corresponding to the same joints of dancers of the same category, curve fitting is performed, and the spatial positions of each joint are corrected according to the curve fitting results to obtain standard dance movements.

[0010] The actual motion adjustment module is used to collect the actual dance movements at time T through wearable devices, obtain the motion offset at time T by comparing the standard dance movements with the actual movements, and output the motion correction result at time T based on the motion offset.

[0011] Furthermore, the dance movement adjustment module is specifically used for:

[0012] Obtain the three-dimensional spatial coordinates of all joints of each dancer, and package the three-dimensional spatial coordinates of all joints of the same dancer into a set, with each dancer corresponding to the set in a one-to-one manner.

[0013] All sets are input into a clustering algorithm, which divides the sets into different classes by measuring the similarity of the three-dimensional spatial coordinates in different sets. The dancers corresponding to the sets in each class perform the same or similar dance moves.

[0014] Furthermore, the dance movement adjustment module is specifically used for:

[0015] The joints in the same set are further classified, and the joints that are classified into the same set represent the same joint;

[0016] Curve fitting is performed based on the three-dimensional spatial coordinates of similar joints. The resulting fitted curve is used to correct the connection lines of similar joints for dancers performing the same or similar dance movements.

[0017] Furthermore, the dance movement adjustment module is specifically used for:

[0018] By adjusting the three-dimensional spatial position of each joint, the joints of the same type performed by dancers performing the same or similar dance movements are located on the fitting curve, and the distance between each joint on the fitting curve is the same.

[0019] Furthermore, the dance movement adjustment module is specifically used for:

[0020] Use at least one of linear functions, polynomial functions, sine / cosine functions, and exponential functions to perform curve fitting on the three-dimensional spatial coordinates of the same type of joint.

[0021] Furthermore, the central controller includes a dance database module, which specifically includes:

[0022] The dance library unit is used to store multiple dance videos, each accompanied by a dance name, style, choreographer, number of performers, and music information;

[0023] The dance analysis unit is used to track dancers' movements in dance videos using computer vision technology and generate 3D virtual models of the dance movements; it is used to decompose dance videos into individual movements or combinations; and it is used to perform rhythm analysis on dance videos to identify the time signature, speed, and rhythmic patterns of the dance.

[0024] Furthermore, the central controller includes a virtual rehearsal module, which specifically includes:

[0025] A 3D modeling unit is used to create a 3D virtual stage using 3D modeling technology; and to enable the 3D virtual model to perform dance movements on the 3D virtual stage.

[0026] The formation library unit is used to store various standing formations, each of which includes the dancer's position and orientation; it is used to provide animated demonstrations of transitions between any two standing formations; and it is used to upload new standing formations.

[0027] The formation setting unit is used to select the formation based on the preset number of dancers; it is also used to adjust the formation, add or remove dancer positions, and adjust the distance between dancers in the 3D virtual stage through the interactive interface.

[0028] This manual also provides a method for monitoring and correcting group dance movements, including:

[0029] Determine the number of dancers in the group, select at least two formations to be used in the performance based on the number of dancers, and obtain the changes between any two formations;

[0030] Based on dance videos, dance movements are obtained or designed for group dances. Wearable devices are used to collect dance movements at different positions at different times during the performance. The dance movements are then corrected to obtain standard dance movements at different positions at different times.

[0031] Create 3D virtual dancers and 3D virtual stages, and then perform virtual dance moves on the 3D virtual stage after combining standard dance moves with the 3D virtual dancers.

[0032] The dance moves and formations were adjusted based on the results of the virtual performance to obtain the final performance form;

[0033] Use wearable devices to capture actual rehearsed dance movements for the final performance;

[0034] By comparing the differences between actual dance movements and standard dance movements, and between actual stances and correct stances, the movements and stances of the actual dance can be corrected.

[0035] The above-mentioned technical solutions adopted in this specification can achieve the following beneficial effects:

[0036] By fitting curves to the joints of dancers performing the same dance moves, the overall motion trajectory of the same type of joints at the same time point is mathematically quantified, thereby capturing a more unified overall trend and form of movement. Specifically, when performing dance moves, the joint coordinates of dancers executing the same move are not entirely consistent, resulting in inconsistencies in the lines connecting their corresponding joints and causing overall dance inconsistencies. By fitting curves to the joints, the fitted curves can serve as a standard reference for how dancers should adjust their joints when performing dance moves. Correcting the dance moves based on these fitted curves can yield more consistent, standardized dance movements. Training based on these standardized movements can improve the overall quality of dance performances. Attached Figure Description

[0037] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0038] Figure 1 This is a schematic diagram of a monitoring system for correcting dance movements, as provided in this specification.

[0039] Figure 2 This is a schematic diagram of the joints provided in this manual;

[0040] Figure 3 The following is a schematic diagram of the curve fitting process provided in this specification: (a) is a schematic diagram of the joint points corresponding to dancers classified into the same category, and (b) is a schematic diagram of curve fitting of the wrist joint points in (a).

[0041] Figure 4 This is a schematic diagram of the interactive interface provided in this manual. Detailed Implementation

[0042] To make the objectives, technical solutions, and advantages of this specification clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments in this specification without creative effort are within the scope of protection of this application.

[0043] Traditional synchronized dance rehearsals rely on the coach's visual observation and verbal instructions. During rehearsals, the coach observes the overall performance of the synchronized dance and individual movement deviations through physical observation or video playback, then provides verbal feedback or posture guidance. However, because each dancer's physical condition and technical level are different, their execution of movements may vary; moreover, inconsistent footwork among dancers can cause deviations in their positions and movement paths from the pre-planned route. These problems are difficult to correct solely through the coach's visual observation and verbal instructions: firstly, this method is highly subjective and cannot provide precise quantitative data, leading to fluctuations in training effectiveness; secondly, verbal instructions often fail to accurately convey the coach's intentions, making it difficult for dancers to accurately understand and execute the coach's requirements.

[0044] With the development and maturation of wearable devices, dance movement correction based on wearable devices is becoming increasingly popular. While wearable device-based dance movement correction is very effective for individual dancers, it is difficult to achieve the overall standard movement of multiple dancers at a given moment in group dances. Low-quality standard movements may lead to a uniformity in the correction of group dance movements using wearable devices, resulting in less effective correction.

[0045] Based on this, the embodiments of this application provide a method such as Figure 1 The diagram shows a monitoring system for correcting dance movements. The system includes N wearable devices for capturing dance movements, N positioning devices, and a central controller. The N wearable devices and N positioning devices are in one-to-one correspondence, where N is a positive integer. The central controller includes:

[0046] The dance movement acquisition module is used to collect dance movements of dancers at different positions at time T (T>>0) via wearable devices. Each dance movement includes multiple joints and their three-dimensional spatial positions, with each joint corresponding one-to-one with a dancer's joint. Specifically:

[0047] For each dancer, obtain the positional information of all joints of any type. These joints include the head, shoulders, elbows, wrists, waist, knees, and ankles. The three-dimensional spatial coordinates of these joints are usually represented by three values, corresponding to their positions on the vertical x, y, and z axes, respectively.

[0048] The dance movement adjustment module categorizes dancers in different positions into different classes based on their three-dimensional spatial location. Dancers in the same class perform the same dance movements at time T. Curve fitting is performed on the three-dimensional spatial positions of the joints corresponding to the same joints of dancers in the same class. The spatial positions of each joint are then corrected based on the curve fitting results to obtain standard dance movements. Specifically:

[0049] Wearable devices were used to capture the approximate standard movements performed by N dancers at time T, and the position coordinates of each joint in three-dimensional space were recorded, such as... Figure 2 As shown, the three-dimensional spatial coordinates of all joints of the same dancer are packaged into a set. Each set contains the three-dimensional spatial coordinates of all joints of a dancer, and each dancer corresponds one-to-one with each set.

[0050] All sets are input into a clustering algorithm, which divides the sets into different classes by measuring the similarity of their three-dimensional spatial coordinates. Dancers in each class perform the same or similar dance moves. Figure 3 (a) Demonstrates dance movements that are classified into the same category.

[0051] The joints in the same set are further classified. The joints that are classified into the same set represent the same joint. That is, the joints of dancers who perform the same dance movement are classified. For example, the joints corresponding to the left shoulder are classified into one category, or the joints corresponding to the right knee are classified into another category.

[0052] Curve fitting is performed based on the three-dimensional spatial coordinates of similar joints. Figure 3 (b) is based on Figure 3 (a) The straight line fitted by the coordinate position of the wrist joint can also be a polynomial function curve, a sine / cosine function curve, or an exponential function curve.

[0053] The obtained fitted curves are used to correct the joint point connections corresponding to the same type of joints performed by dancers performing the same or similar dance movements. The spatial coordinates of the joints within each category are corrected. This correction can adjust for potential errors or individual differences in the data, making the movements in each category closer to a standardized template. The spatial coordinates of the joints within each category are corrected to standard dance movements. These movements can be considered as a template or reference standard followed by all dancers in that category. Figure 3 In (a), the actual connection of the wrist joints is not smooth and has undulations, resulting in inconsistent overall dance perception. By adjusting the three-dimensional spatial position of each joint, the joints of the same type performed by dancers are located on the fitted curve, and the spacing between the joints on the fitted curve is the same, resulting in consistent overall dance perception and more standardized movements.

[0054] The actual motion adjustment module is used to collect N actual dance movements at time T via wearable devices, obtain the motion offset at time T by comparing N standard dance movements with the N actual movements, and output the N motion correction results at time T based on the motion offset. Specifically:

[0055] The differences between N dance movement data at time T and N preset standard dance movement data at time T are calculated to obtain N movement offsets at time T. The differences between TN position data and N correct positions at time T are also calculated to obtain N position offsets at time T. Combining the N movement offsets and N position offsets, N movement correction results at time T are output. These correction results include footwork correction results and body posture correction results. Footwork correction results include foot position and direction of movement, while body posture correction results may include body posture, joint angles, and limb positions. These correction results are presented to the dancer in a visual manner.

[0056] The dance database module includes a dance database unit and a dance analysis unit. Specifically:

[0057] The dance library unit is used to track dancers' movements in dance videos using computer vision technology and generate 3D virtual models of dance movements; it is used to decompose dance videos into individual movements or combinations; and it is used to perform rhythm analysis on dance videos to identify the time signature, speed, and rhythmic patterns of the dance.

[0058] The virtual rehearsal module specifically includes:

[0059] A 3D modeling unit is used to create a 3D virtual stage using 3D modeling technology; and to enable the 3D virtual model to perform dance movements on the 3D virtual stage.

[0060] The formation library unit is used to store various standing formations, each of which includes the dancer's position and orientation; it is used to provide animated demonstrations of transitions between any two standing formations; and it is used to upload new standing formations.

[0061] The formation setting unit is used to select a formation based on a preset number of dancers; it is also used to adjust the formation, add or remove dancers, and adjust the distance between dancers on a 3D virtual stage via an interactive interface, such as... Figure 4 As shown.

[0062] The music analysis module includes a music library unit, a music analysis unit, a music editing unit, and a music visualization unit. Specifically:

[0063] The Music Library unit is used to categorize and store several different types of audio files locally or in the cloud. Each audio file includes information such as name, style, performance duration, instrument played, and performer. It allows users to search for matching audio files and upload new ones. The Music Analysis unit uses music analysis tools to identify the beat of music: time signature, tempo, and rhythmic pattern, and obtain the timing and duration of each beat. It can also obtain the structural elements of music: sections, choruses, and bridges, as well as the timing and duration of each structural element; and it can obtain the dynamic changes of music: crescendo and diminuendo, as well as the timing and duration of each dynamic change. The Music Editing unit allows users to trim, splice, and adjust the tempo of audio files using audio editing tools. The Music Visualization unit uses visualization tools such as Music21 or Librosa to present music in visual form, such as waveform graphs, spectrograms, and rhythm grids.

[0064] The choreography support module includes a music recommendation unit and a music-dance matching unit. Specifically:

[0065] The music recommendation unit recommends music based on historical music selection, dance style, and movement characteristics. The music-dance matching unit synchronizes music analysis with dance movements based on the music's rhythm, tempo, time signature, and structure, as well as the dance's pauses, exertions, and dynamic changes. It also provides a visual interface, allowing choreographers to see the synchronization between the music waveform, rhythm grid, and dance movements; and allows choreographers to adjust the duration, intensity, and rhythm of dance movements to match the music.

[0066] The above are one or more embodiments of the monitoring system for dance movement correction provided in this specification. Based on the same idea, this specification also provides a corresponding monitoring method for dance movement correction, including the following steps:

[0067] Set a dance style and get the corresponding music based on that style.

[0068] Determine the number of dancers in the group, select at least two formations to be used in the performance based on the number of dancers, and obtain the changes between any two formations.

[0069] Based on dance videos, dance movements for group dances are obtained or designed. Wearable devices are used to collect approximate dance movements at different positions at different times during the performance. The approximate dance movements are then corrected to obtain standard dance movements at different positions at different times.

[0070] Create 3D virtual dancers and 3D virtual stages, then combine standard dance moves with the 3D virtual dancers to perform virtual dances within the 3D virtual stage.

[0071] The dance moves and formations are adjusted based on the results of the virtual performance to obtain the final performance form.

[0072] Wearable devices were used to capture actual rehearsed dance movements for the final performance.

[0073] By comparing the differences between actual dance movements and standard dance movements, and between actual stances and correct stances, the movements and stances of the actual dance can be corrected.

[0074] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0075] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A monitoring and correction system for group dance choreography, characterized by, It includes a central controller and several wearable devices for capturing dance movements; the central controller includes: The dance movement acquisition module is used to collect the dance movements of dancers at different positions at time T using wearable devices, where T>>0; each dance movement includes multiple joints and the three-dimensional spatial position of each joint, and the joints correspond one-to-one with the dancer's joints; The dance movement adjustment module is used to classify dancers in different positions into different categories based on their three-dimensional spatial positions. Dancers in the same category perform the same dance movements at time T. It performs curve fitting based on the three-dimensional spatial positions of the joints corresponding to the same joints of dancers in the same category, and corrects the spatial positions of each joint based on the curve fitting results to obtain standard dance movements. It also acquires the three-dimensional spatial coordinates of all joints of each dancer and packages the three-dimensional spatial coordinates of all joints of the same dancer into a set, with each dancer corresponding to one set. All sets are input into a clustering algorithm, which divides the sets into different categories by measuring the similarity of the three-dimensional spatial coordinates. Dancers in each category perform the same or similar dance movements. The module further classifies the joints in the same category, with joints in the same category representing the same joint. Curve fitting is performed based on the three-dimensional spatial coordinates of the joints in the same category, and the obtained fitted curve is used to correct the connection lines between joints in the same category of dancers performing the same or similar dance movements. The actual motion adjustment module is used to collect the actual dance movements at time T through wearable devices, obtain the motion offset at time T by comparing the standard dance movements with the actual movements, and output the motion correction result at time T based on the motion offset.

2. The monitoring and correction system for group dance movements as described in claim 1, characterized in that, The dance movement adjustment module is specifically used to: adjust the three-dimensional spatial position of each joint so that the joints of the same type of dancers performing the same or similar dance movements are located on the fitting curve, and the distance between each joint on the fitting curve is the same.

3. The monitoring and correction system for group dance movements as described in claim 1, characterized in that, The dance movement adjustment module is specifically used to: use at least one of linear functions, polynomial functions, sine / cosine functions, and exponential functions to perform curve fitting on the three-dimensional spatial position coordinates of similar joint points.

4. The monitoring and correction system for group dance movements as described in claim 1, characterized in that, The central controller includes a dance database module, which specifically includes: The dance library unit is used to store multiple dance videos, each accompanied by a dance name, style, choreographer, number of performers, and music information; The dance analysis unit is used to track dancers' movements in dance videos using computer vision technology and generate 3D virtual models of the dance movements; it is used to decompose dance videos into individual movements or combinations; and it is used to perform rhythm analysis on dance videos to identify the time signature, speed, and rhythmic patterns of the dance.

5. The monitoring and correction system for group dance movements as described in claim 4, characterized in that, The central controller includes a virtual rehearsal module, which specifically includes: A 3D modeling unit is used to create a 3D virtual stage using 3D modeling technology; and to enable the 3D virtual model to perform dance movements on the 3D virtual stage. The formation library unit is used to store various standing formations, each of which includes the dancer's position and orientation; it is used to provide animated demonstrations of transitions between any two standing formations; and it is used to upload new standing formations. The formation setting unit is used to select the formation based on the preset number of dancers; it is also used to adjust the formation, add or remove dancer positions, and adjust the distance between dancers in the 3D virtual stage through the interactive interface.

6. A monitoring and correction method for a monitoring and correction system for group dance movements according to any one of claims 1 to 5, characterized in that, include: Determine the number of dancers in the group, select at least two formations to be used in the performance based on the number of dancers, and obtain the changes between any two formations; Based on dance videos, dance movements are obtained or designed for group dances. Wearable devices are used to collect dance movements at different positions at different times during the performance. The dance movements are then corrected to obtain standard dance movements at different positions at different times. Create 3D virtual dancers and 3D virtual stages, and then perform standard dance moves with the 3D virtual dancers within the 3D virtual stage. The dance moves and formations were adjusted based on the results of the virtual performance to obtain the final performance form; Use wearable devices to capture actual rehearsed dance movements for the final performance; By comparing the differences between actual dance movements and standard dance movements, and between actual stances and correct stances, the movements and stances of the actual dance can be corrected.

Images