Multi-angle dance video analysis system

Through the multi-angle dance video analysis system, the Vietoris-Rips compound method and multi-scale persistent co-ordination analysis, combined with multi-dimensional scale analysis, the problem of insufficient analysis of three-dimensional characteristics and style diversity in the existing technology is solved, and dance is realized Efficient, precise analysis and style prediction of actions.

CN119228852AActive Publication Date: 2024-12-31SICHUAN NORMAL UNIV

Patent Information

Application Number
CN202411755704.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-03
Publication Date
2024-12-31
Estimated Expiration
2044-12-03

AI Technical Summary

Technical Problem

The existing multi-angle dance video analysis system relies on sensors and a single or limited camera angle, making it difficult to fully capture the three-dimensional characteristics of the movement. The traditional method lacks its performance in dealing with action continuity and style diversity, and cannot accurately distinguish complex action patterns or captures. Subtle style differences limit the application of dance teaching, choreography and scientific research.

Method used

The multi-angle dance video analysis system is adopted, and the spatial connection mode is identified through the motion capture feature extraction module using the Vietoris-Rips complex method. The multi-scale analysis module of the action data uses multi-scale persistent co-ordination analysis to determine spatial and temporal continuity, and the action analysis and mapping module Perform multi-dimensional scaling analysis, map the action data to low-dimensional space, generate action maps, and style classification and prediction modules analyze dance style changes and predict style changes.

Benefits of technology

It realizes the three-dimensional data analysis of dance movements, accurately distinguishes and classifies differentiated styles and repetitive action patterns, improves the sensitivity to subtle differences in action styles, significantly improves the visualization and analysis ability of action data, and provides comprehensive and in-depth The dance motion analysis tool exceeds most of the limitations of traditional technology.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119228852A_ABST
    Figure CN119228852A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of action analysis, in particular to a multi-angle dance video analysis system which comprises an action capture feature extraction module, an action data multi-scale analysis module, an action analysis and mapping module and a style classification and prediction module. According to the method, through a multi-angle video recording and Vietories-Rips complex method, the space connection mode of dance is effectively identified and extracted, the geometric structure of the action is captured, three-dimensional action data analysis and multi-scale persistent homology analysis are provided to enhance analysis on the time sequence and the space layout of the action, and the dance style and the action mode are accurately distinguished; high sensitivity to fine difference of styles is brought, dance style evolution can be accurately predicted, action data is mapped to a low-dimensional space through multi-dimensional scale analysis, data visualization and analysis capacity is remarkably improved, action similarity and difference are displayed, dance education, choreography and therapy are assisted, full-process optimization of data analysis is achieved, and the method is suitable for popularization and application. And a comprehensive and deep dance motion analysis tool is provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of motion analysis, and in particular to a multi-angle dance video analysis system. Background Art

[0002] The field of motion analysis technology involves the use of sensors, cameras, and image capture devices to record and analyze the movements of people or objects. In this field, specialized software and hardware systems are designed to analyze motion data, providing detailed insights into physical movement. This includes aspects such as motion capture, posture assessment, motion reproduction, and motion efficiency analysis. Motion analysis technology is widely used in sports science, physical therapy, filmmaking, and video game development, assisting professionals in optimizing performance, diagnosing problems, and improving user experience. This technology can not only analyze single-angle footage but also process multi-angle and multi-dimensional data to obtain more comprehensive motion information.

[0003] Among them, the Multi-Angle Dance Video Analysis System is a high-tech system specifically designed to capture dance movements from multiple angles and conduct detailed analysis. The system uses multiple cameras to synchronously record the dancer's movements and uses advanced image processing and machine learning algorithms to analyze the video to identify the characteristics and patterns of dance movements. The main uses of this system include providing feedback to dance teachers and students to improve performance techniques, assisting in dance choreography, and providing experimental data for dance research. It can also be applied to dance therapy, assisting therapists in evaluating treatment effectiveness by analyzing the fluidity, strength, and rhythm of movements.

[0004] Existing technologies provide foundational tools for dance motion research, but their reliance on sensors and single or limited camera angles limits the dimensionality and perspective of motion data, making it difficult to fully capture the three-dimensional characteristics of movement. Traditional methods also struggle with handling movement continuity and stylistic diversity, failing to accurately distinguish complex movement patterns or capture subtle stylistic differences. This technical limitation restricts its application in dance teaching and choreography, preventing it from providing sufficient data support for high-precision technical analysis and style prediction. In sports science, there is a lack of technical support for in-depth analysis of movement continuity, and traditional motion analysis techniques are insufficient in multidimensional data analysis and visualization, limiting the comprehensive analysis and application of complex movement data. Summary of the Invention

[0005] The purpose of the present invention is to solve the shortcomings of the prior art and to propose a multi-angle dance video analysis system.

[0006] In order to achieve the above object, the present invention adopts the following technical solution: A multi-angle dance video analysis system includes: The motion capture feature extraction module uses the Vietoris-Rips complex method to connect data points based on a multi-angle dance video dataset, identify spatial connection patterns in the dance, extract spatial relationship data, and obtain topological network features; The motion data multi-scale analysis module applies multi-scale persistent homology analysis based on the topological network features to determine the spatial and temporal continuity of dance movements and obtain spatial and temporal continuity results. The spatial and temporal continuity results are used to identify movement patterns that appear in differentiated dance styles and obtain a basic movement pattern set. The motion analysis and mapping module performs multidimensional scaling analysis on the motions in the multi-angle dance videos based on the basic motion pattern set, maps the motion data into a low-dimensional space, and obtains a motion mapping diagram. The motion mapping diagram is used to display the similarities and differences between the dance motions and obtain a dance motion relationship diagram. The style classification and prediction module analyzes the changes and trends of dance styles based on the dance movement relationship diagram, performs state analysis on the dance movement sequence, generates a dance state transition diagram, predicts dance style changes through the dance state transition diagram, and obtains dance video style prediction analysis results.

[0007] As a further solution of the present invention, the steps of obtaining the topological network characteristics are specifically as follows: Based on a multi-angle dance video dataset, we analyze each dance movement and extract key coordinate points. We then record the changes in key coordinate points over time and generate dance movement time series data. Applying the Vietoris-Rips complex method to the dance movement time series data, connecting the data points, and establishing a spatial connection graph according to a distance threshold; According to the spatial connectivity graph, key connectivity patterns are extracted and the connectivity of multiple connectivity patterns is calculated using the formula: ; Get topological network characteristics, where represents a spatial connectivity graph, It is the weight adjusted according to the geometric characteristics and dynamic changes of the connection points. Represents the distance between connection points, represents the attenuation coefficient, Indicators of key connectivity patterns in the spatial connectivity graph representing dance movements, Indicates the total number of connection points.

[0008] As a further solution of the present invention, the steps for obtaining the spatial-temporal continuity result are specifically as follows: Based on the topological network characteristics, a multi-scale persistent homology analysis method was applied to evaluate the topological stability of dance movements. By calculating the Betti numbers at multiple scales, the continuity of the spatial structure was identified and preliminary topological analysis results were generated. Based on the preliminary topological analysis results, we analyzed the time series data of dance movements at multiple scales, used temporal coherence techniques to evaluate the temporal persistence of movements, and generated temporal stability analysis results of movements. Combining the preliminary topological analysis results and the motion temporal stability analysis results, the scores of spatial and temporal data are calculated using the formula: ; Generates a spatial-temporal continuity result where represents the score after spatial and temporal data analysis, Represents a topological complex of time and space, represents the spatial continuity score of the k-th time window, represents the corresponding time continuity score, Indicates the total number of time windows.

[0009] As a further solution of the present invention, the steps of obtaining the basic action pattern set are specifically as follows: Utilizing the spatial-temporal continuity results, analyzing dance data, identifying movement patterns of differentiated styles, classifying the movements through cluster analysis, and generating movement pattern classification results; Analyzing the action pattern classification results, using frequent item set mining technology to capture basic action combinations appearing in the style, and generating a frequent action pattern set; Combined with the frequent action pattern set, the representativeness and difference of each pattern are calculated using the formula: ; Generate a set of basic action patterns, where Represents a set of basic action patterns, represents the frequency of occurrence of pattern z, represents the difference weight corresponding to mode z, Indicates the total number of modes.

[0010] As a further solution of the present invention, the steps of obtaining the action map are specifically as follows: Analyzing multi-angle dance videos recorded in the basic movement pattern set, identifying key movement features in multiple videos, marking multi-dimensional attributes of each movement using statistical methods, and generating a movement feature label list; Based on the action feature label list, applying multidimensional scaling analysis technology to convert high-dimensional data into low-dimensional data representation to generate a low-dimensional feature mapping matrix; Based on the low-dimensional feature mapping matrix, the vector distance calculation formula is used: ; Generate an action map, where represents the spatial geometric clarity of the mapping, represents the vector position of the i-th action feature in the low-dimensional space, Represents the total action feature quantity.

[0011] As a further solution of the present invention, the steps of obtaining the dance movement relationship diagram are specifically as follows: Based on the action map, by analyzing the distance and configuration between multiple points in the map, a multidimensional scaling analysis method is applied to determine the similarities and differences between the actions to obtain preliminary action relationship data; The preliminary action relationship data is converted into visual coordinates through matrix transformation method, and the Euclidean distance between actions is calculated using the formula: ; Generate a distance matrix where represents the Euclidean distance between two action points in the dance action mapping graph, 、 represents the x and y coordinates of the action in low-dimensional space, 、 Represents the coordinates of another action; According to the distance matrix, a graphical algorithm is used to convert the action relationship into a visual chart, identify key and secondary action nodes, connect key action nodes to highlight the main line of the dance process, and connect auxiliary secondary action nodes to refine the details of the dance action. The criticality of differentiated action nodes is distinguished by color and line thickness, the layout of the visual chart is adjusted and the clarity of information display is optimized to generate a dance action relationship diagram.

[0012] As a further solution of the present invention, the steps of obtaining the dance state transition diagram are specifically as follows: Extracting each action node and its association from the dance action relationship graph, calculating the in-degree and out-degree of each node, each node representing an independent dance action, identifying potential connections between the connectivity data actions, and generating a node association matrix; The node association matrix is ​​used to determine the transition probabilities between dance moves, and the transition probability calculation formula is applied: ; Generate an action transition probability matrix, where represents the node degree of the starting action, represents the node degree of the end action, k is the sensitivity adjustment coefficient, is the state transition probability, e represents the base of the natural logarithm; According to the action transition probability matrix, a state transition diagram is drawn using a graph theory algorithm, and the transition paths and probability sizes between differentiated dance actions are displayed to form a dance state transition diagram.

[0013] As a further solution of the present invention, the steps for obtaining the dance video style prediction analysis results are specifically as follows: Based on the dance state transition graph, data on key dance movements and transition frequencies are extracted, and graph network analysis technology is used to identify key style influencing factors and obtain movement relationship feature data; Based on the action relationship feature data, sequence analysis technology is applied to predict the transition path of dance style using the formula: ; Get dance style transition prediction data, where represents the predicted value predicted by the dance state transition graph, and Indicates the state of continuous dance movements. 、 、 are model parameters; The dance style transition prediction data is integrated, and multiple style indicators are combined through data fusion technology to capture the movement data of multiple styles in the dance video. The data is classified and organized, and the trend of dance style change is identified using time series analysis. The trend data is matched with the style indicators, and the analysis results are presented as charts through visualization tools to generate dance video style prediction analysis results.

[0014] Compared with the prior art, the advantages and positive effects of the present invention are: In this invention, by using multi-angle video data and the Vietoris-Rips complex method, spatial connection patterns in dance are effectively identified and extracted, not only capturing the geometric structure of the movements, but also revealing the complex spatial relationships between movements, thereby providing a richer three-dimensional motion data analysis than traditional single-view or two-dimensional analysis. Multi-scale persistent homology analysis is used to further enhance the analysis of movement time series and spatial layout, allowing the system to accurately distinguish and classify differentiated dance styles and repetitive movement patterns. This in-depth analysis brings a high sensitivity to subtle differences in movement styles, which helps to accurately predict and classify the evolution of dance styles. The movement data is mapped to a low-dimensional space through multidimensional scaling analysis, significantly improving the visualization and analysis capabilities of the movement data, allowing the similarities and differences between movements to be intuitively presented. This not only helps dance teachers and students analyze and improve dance techniques from multiple dimensions, but also provides scientific data support for dance choreography and therapy, achieving full process optimization from data acquisition to analysis, and providing a comprehensive and in-depth dance movement analysis tool, thus surpassing most of the limitations of existing technologies. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a system flow chart of the present invention; Figure 2 A flow chart showing the topological network features of the present invention; Figure 3 This is a flow chart of the spatial-temporal continuity results of the present invention; Figure 4 is a flow chart of the basic action mode set in the present invention; Figure 5 is a flow chart of the action mapping diagram in the present invention; Figure 6 A flowchart of a dance movement relationship diagram in the present invention; Figure 7 is a flow chart of a dance state transition diagram in the present invention; Figure 8 Flowchart of the dance video style prediction analysis results in the present invention. DETAILED DESCRIPTION

[0016] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to analyze the present invention and are not intended to limit the present invention.

[0017] In the description of the present invention, it is necessary to understand that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating directions or positional relationships, are based on the directions or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific direction, be constructed and operate in a specific direction. Therefore, they cannot be interpreted as limitations on the present invention. In addition, in the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0018] See also Figure 1 , a multi-angle dance video analysis system includes: The motion capture feature extraction module uses the Vietoris-Rips complex method to connect data points based on a multi-angle dance video dataset, identify spatial connection patterns in the dance, extract spatial relationship data, and obtain topological network features; The multi-scale motion data analysis module uses multi-scale persistent homology analysis based on topological network characteristics to determine the spatial and temporal continuity of dance movements and obtain spatial and temporal continuity results. Through the spatial and temporal continuity results, the module identifies the movement patterns that appear in differentiated dance styles and obtains a basic movement pattern set. The motion analysis and mapping module performs multidimensional scaling analysis on the movements in multi-angle dance videos based on a set of basic motion patterns, maps the motion data into a low-dimensional space, and obtains a motion map. Through the motion map, the similarities and differences between dance movements are displayed, and a dance movement relationship diagram is obtained. The style classification and prediction module analyzes the changes and trends of dance styles based on the dance movement relationship diagram, performs state analysis on the dance movement sequence, generates a dance state transition diagram, predicts dance style changes through the dance state transition diagram, and obtains the dance video style prediction analysis results.

[0019] Topological network features include node type, edge connectivity, and network topology; spatial-temporal continuity results include time series, spatial configuration, and persistence indicators; the basic action pattern set includes action elements, frequency characteristics, and style conformity; the action mapping diagram includes mapping dimension, spatial vector, and mapping accuracy; the dance action relationship diagram includes action connection points, similarity classification, and action network; the dance state transition diagram includes state classification, transition frequency, and state path; and the dance video style prediction analysis results include prediction model, style distribution, and recognition accuracy.

[0020] See also Figure 2 ,The specific steps for obtaining topological network features are: Based on a multi-angle dance video dataset, we analyze each dance movement and extract key coordinate points. We then record the changes in key coordinate points over time and generate dance movement time series data. The analysis based on the multi-angle dance video dataset aims to extract key coordinate points. The process first involves parsing the dance movements in each frame of the video and identifying the positions of key joints and body parts in the movements. The coordinate data of each key coordinate point changes over time. The data is recorded by dedicated software and encoded into a time series format. The time series data includes the specific time point when each movement is performed and its precise position in space. The continuous data stream provides the basis for subsequent analysis, and then the time series data is processed by algorithms to identify specific patterns in the dance. The patterns reflect the coherence and rhythm of the dance movements, and ultimately generate dance movement time series data.

[0021] The Vietoris-Rips complex method is applied to the dance movement time series data to connect the data points and establish a spatial connection graph based on the distance threshold. The Vietoris-Rips complex method is applied to dance movement time series data. By calculating the distance between data points, a multidimensional spatial network is constructed, in which each data point represents a key coordinate point of a dance movement. The connection distance threshold is determined by statistical analysis of the distance between all movement data points. The selection of this threshold is key in determining which points will be considered adjacent and thus connected. The construction of the spatial connection diagram refers to the relative positions between joints and body parts in dance movements. By comparing the recurrence of similar positions in differentiated dance clips, it is determined which movements are part of the repeated or characteristic movements in the dance, and a spatial connection diagram representing the dance structure is generated.

[0022] According to the spatial connection graph, key connection patterns are extracted and the connectivity of multiple connection patterns is calculated using the formula: ; Get topological network characteristics, where Represents a spatial connection graph, which is a weight adjusted according to the geometric characteristics and dynamic changes of the connection points. Represents the distance between connection points, represents the attenuation coefficient, Indicators of key connectivity patterns in the spatial connectivity graph representing dance movements, Indicates the total number of connection points; The benefit of this formula is that it can refer to the combined influence of the distance and connection strength of key connection points in dance. Through this weighted average method, it can more accurately reflect the importance of the spatial connection pattern of dance movements. set up A spatial connection diagram for dance, is the weight of the i-th connection, which is adjusted based on the geometric characteristics and dynamic changes of the connection. is the distance between the i-th connection points, calculated using Euclidean distance, is the attenuation coefficient, which is adjusted according to the speed and rhythm of the dance movements to better control the impact of distance factors on connection strength.

[0023] Taking the specific values ​​as an example, there are three connections with weights of 0.5, 1, and 0.5, and distances of 1m, 2m, and 1.5m, respectively. The attenuation coefficients are Set to 1, the calculation process is as follows: ; The results show that after referring to the combined effects of connection strength and distance, the tightness of the spatial connection pattern of dance movements is approximately 0.223, and the value reflects the overall structure and tightness of the connections between key movements in dance.

[0024] See also Figure 3 , the steps to obtain the spatial and temporal continuity results are as follows: Based on the characteristics of the topological network, a multi-scale persistent homology analysis method is applied to evaluate the topological stability of dance movements. By calculating the Betti numbers at multiple scales, the continuity of the spatial structure is identified and preliminary topological analysis results are generated. In the preliminary implementation of multi-scale persistent homology analysis based on topological network characteristics, dance movement data were collected and converted into a format that can be used for analysis. By calculating the Betti numbers at differentiated scales, the analysis assisted in identifying and quantifying the continuity of the spatial structure of dance movements. This method can identify spatial patterns that are stable under multi-scale monitoring by analyzing the topological structure at the differentiated level. This process involves not only data collection and preprocessing, but also complex mathematical modeling to ensure the accuracy and reliability of the results obtained, generating preliminary topological analysis results, which provide basic data and reference standards for further spatial and temporal continuity analysis.

[0025] Based on the preliminary topological analysis results, we analyzed the time series data of dance movements at multiple scales, used temporal coherence techniques to evaluate the temporal continuity of movements, and generated temporal stability analysis results of movements. After obtaining the preliminary topological analysis results, the data is further combined to analyze the time series of dance movements. This stage mainly involves the application of time synchronization technology, which allows the evaluation of the continuity and change patterns of movements in time. This technology identifies the topological characteristics that change over time through further analysis of time series data. The process requires not only a high degree of data synchronization technology, but also precise processing of time data to ensure that the analysis results of time continuity accurately reflect the true characteristics of the movement. Through complex analysis, the time continuity analysis results are generated, which further enriches the analysis and interpretation of the continuity of dance movements.

[0026] Combining the preliminary topological analysis results and the motion temporal stability analysis results, the scores of spatial and temporal data are calculated using the formula: ; Generates a spatial-temporal continuity result where represents the score after spatial and temporal data analysis, Represents a topological complex of time and space, represents the spatial continuity score of the k-th time window, represents the corresponding time continuity score, Indicates the total number of time windows; The benefit of the formula is that it integrates the analysis results of spatial and temporal dimensions, providing a new perspective to analyze the continuity and fluidity of dance movements; set up A topological complex of time and space, and Represent the spatial and temporal continuity scores of each time window k, respectively. For example, if there are three time windows, the spatial scores of each window are 0.8, 0.7, and 0.9, and the temporal scores are 0.5, 0.6, and 0.7, respectively. The calculation is as follows: ; The results show that, by integrating the spatial and temporal analysis of multiple time windows, the overall spatial-temporal continuity score of the dance movements is 1.45. The score reflects that the dance movements maintain a high degree of continuity and fluidity within a given time window. This numerical result further confirms the effectiveness of the analysis method and the continuity characteristics of the dance movements.

[0027] See also Figure 4 , the steps to obtain the basic action pattern set are as follows: Using the spatial-temporal continuity results, we analyze dance data, identify movement patterns of different styles, classify the movements through cluster analysis, and generate movement pattern classification results; By utilizing the results of spatial-temporal continuity, the process begins with a detailed analysis of the spatial and temporal properties of the dance styles, focusing mainly on identifying the unique movement patterns between each style. During the execution process, it not only involves in-depth mathematical and statistical analysis of the existing classified movement data, but also includes the use of machine learning techniques such as cluster analysis to distinguish and identify the movement characteristics of differentiated styles, ensuring that the movement patterns of each dance style are effectively identified and classified. The classification results provide a scientific basis for the next step of pattern set extraction, and ensure that the information extracted from the movement data is maximized, laying a solid foundation for creating a more accurate movement pattern set.

[0028] Analyze the action pattern classification results, use frequent item set mining technology to capture the basic action combinations that appear in the style, and generate frequent action pattern sets; Continuing from the preliminary movement pattern classification results, we further applied frequent item set mining technology, which is a technology used to identify patterns and trends in large data sets. By counting the frequency of multiple movement patterns in the database, we can determine which movement patterns are common. The analysis process not only focuses on the frequency of movement, but also evaluates the distribution of frequently occurring movement patterns in differentiated dance styles, thereby obtaining movement combinations with high support and confidence. The combination reflects the most basic and common movement characteristics of the dance style, providing key data support for the formation of the final basic movement pattern set.

[0029] Combined with the set of frequent action patterns, the representativeness and difference of each pattern are calculated using the formula: ; Generate a set of basic action patterns, where Represents a set of basic action patterns, represents the frequency of occurrence of pattern z, represents the difference weight corresponding to mode z, Indicates the total number of modes; The benefit of the formula is that it provides a comprehensive method of determining the basic movement pattern set with reference to frequency and importance by quantifying the frequency of occurrence of each movement pattern and its uniqueness in dance; set up Represents a set of basic action patterns, is the total number of reference action patterns, and They represent the frequency of occurrence and difference weight of the z-th action pattern, respectively. For example, if there are three action patterns with frequencies of 0.2, 0.3, and 0.5, and difference weights of 2, 5, and 3, respectively, the calculation process is as follows: ; The results show that the total score of the basic movement pattern set is 3.4, which reflects the comprehensive influence of the importance and uniqueness of the basic patterns in the overall dance style, and further guides the focus of dance training and performance.

[0030] See also Figure 5 , the steps for obtaining the action map are as follows: Analyze multi-angle dance videos that record basic movement patterns, identify key movement features in multiple videos, and use statistical methods to label the multidimensional attributes of each movement to generate a list of movement feature labels; We analyzed multi-angle dance videos that recorded basic movement patterns, identified key movement features in each video, and used statistical methods to label each movement in detail with multidimensional attributes, including speed, rhythm, spatial occupancy, and frequency of occurrence in differentiated dance styles. This process used advanced data classification and pattern recognition techniques to ensure the accuracy and comprehensiveness of the labeling, ultimately generating a list of labels containing detailed descriptions of each movement feature. The labels will then be used for further multidimensional analysis.

[0031] Based on the action feature label list, multidimensional scaling analysis technology is applied to transform high-dimensional data into low-dimensional data representation and generate a low-dimensional feature mapping matrix; The list of movement feature labels extracted from multi-angle dance videos is processed, and multidimensional scaling analysis technology is used to convert high-dimensional data into a low-dimensional space representation to ensure that the overall structure and correlation of the data are preserved. This conversion process relies on complex mathematical models and algorithms, including the construction of distance matrices and dimensionality compression, which provides a scientific basis for generating accurate low-dimensional feature mapping matrices. The matrix will directly affect the quality and interpretability of the movement map.

[0032] Based on the low-dimensional feature mapping matrix, the vector distance calculation formula is used: ; Generate an action map, where represents the spatial geometric clarity of the mapping, represents the vector position of the i-th action feature in the low-dimensional space, Represents the total action feature quantity; The benefit of the formula is that by calculating the Euclidean distance of all motion vectors in a low-dimensional space, it can effectively measure and display the similarities and differences between dance movements, enhance the resolution and visual effects of the motion map, and enable researchers to more clearly identify and distinguish the basic movement patterns in differentiated dance styles. Low-dimensional feature data obtained from multidimensional scaling analysis , calculate the Euclidean distance of each action vector, and based on this, further calculate the spatial distance between all actions to provide a numerical basis for constructing the action mapping diagram. In the example, set , ,but The calculation is: ; The results show that the motion maps calculated by this method can effectively express the key characteristics of the original high-dimensional motion data in two-dimensional or three-dimensional space, making the comparison and analysis of motions more intuitive and accurate.

[0033] See also Figure 6 , the specific steps for obtaining the dance action relationship diagram are: Based on the action map, by analyzing the distance and configuration between multiple points in the map, the multidimensional scaling analysis method is applied to determine the similarities and differences between actions and obtain preliminary action relationship data; By analyzing the distance and configuration between each point in the map, and using the known coordinate data in the action map, a multidimensional scaling analysis is performed. This analysis reveals the similarity between actions by quantifying the Euclidean distance between each action point, thereby preliminarily mapping the relative positional relationship between dance actions. The data will serve as the basis for creating a relationship diagram in the subsequent steps, thereby providing the necessary input parameters for the next step of processing.

[0034] The preliminary action relationship data is converted into visual coordinates through matrix transformation method, and the Euclidean distance between actions is calculated using the formula: ; Generate a distance matrix where represents the Euclidean distance between two action points in the dance action mapping graph, 、 represents the x and y coordinates of the action in low-dimensional space, 、 Represents the coordinates of another action; The benefit of the formula is that by calculating the Euclidean distance between each pair of movements, the similarities and differences between movements can be quantified, which helps to accurately represent the positional relationship of each dance movement in the movement relationship graph; Each point in the dance map has coordinates and , the formula for calculating the distance between two points is The distance between each pair of actions can be obtained. For example, for the specific points (3, 4) and (0, 0), the distance is calculated as ; This result reveals the relative spatial positions of the two dance movements in the mapping diagram, which demonstrates the accuracy of the movement mapping diagram and the clear expression of the relationship between movements, further verifying the effectiveness of using this formula.

[0035] Based on the distance matrix, a graphical algorithm is used to convert the movement relationship into a visual diagram. Key and secondary movement nodes are identified. Key movement nodes are connected to highlight the main line of the dance process. The connection lines of auxiliary movement nodes are used to refine the details of the dance movement. The key points of different movement nodes are distinguished by color and line thickness. The layout of the visual diagram is adjusted and the clarity of the information is optimized to generate a dance movement relationship diagram. The distance data between all movements is converted into a visual relationship diagram through a graphical algorithm. The implementation process of the algorithm is explained in detail, including the sorting of distance data, cluster analysis and the rendering method of the final graph. The process not only tests data processing skills, but also demonstrates how to convert theoretical data into graphics that users can directly view. The results show the connections and differences between dance movements, providing new perspectives and tools for dance research.

[0036] See also Figure 7 , the specific steps for obtaining the dance state transition diagram are: Extract each action node and its association from the dance action relationship graph, calculate the in-degree and out-degree of each node, each node represents an independent dance action, identify the potential connection between the connectivity data actions, and generate a node association matrix; Node data is extracted from the dance movement relationship graph. The nodes represent differentiated dance movements. The connections between the movements are analyzed. By calculating the connection density and direction of each node, the similarities and differences between differentiated dance styles can be revealed. Based on the data, the popular trends and style evolution of dance movements are analyzed, and finally a dance style prediction model is generated. The model can be used to guide dance choreography and teaching.

[0037] Using the node association matrix, determine the transition probability between dance moves and apply the transition probability calculation formula: ; Generate an action transition probability matrix, where represents the node degree of the starting action, represents the node degree of the end action, k is the sensitivity adjustment coefficient, is the state transition probability, e represents the base of the natural logarithm; The benefit of the formula is that it can be based on the difference in connection density of action nodes and To adjust the transition probability, k is used as an adjustment coefficient, which can be adjusted according to the specific needs of the dance style. This allows the model to not only reflect the probabilistic relationship between dance moves, but also adapt to changes between differentiated dance styles. First determine the connection density of each dance action node and , get the value through actual data measurement, and then substitute the value into the formula to calculate the transition probability between each pair of dance moves , for example, if , , and set , then calculate ; The results show that based on the given parameters and model settings, the transition probability from action x to action y is 62.2%, which reflects the possibility of transitioning from one specific dance move to another.

[0038] Based on the action transition probability matrix, a graph theory algorithm is used to draw a state transition diagram, and the transition paths and probability sizes between differentiated dance actions are displayed to form a dance state transition diagram; Based on the dance state transition diagram, state analysis technology is further used to identify and predict state changes in dance sequences. By collecting actual performance data of various dance movements and analyzing the patterns and frequencies in the data, it is determined which dance movements appear together and which are less common. This information helps dance teachers and choreographers better analyze the evolution trends of dance styles and provide data support for creation. Ultimately, a visual chart that can dynamically display the evolution of dance styles is obtained.

[0039] See also Figure 8 ,The specific steps for obtaining the dance video style prediction analysis results are: Based on the dance state transition graph, data on key dance movements and transition frequencies are extracted. Graph network analysis techniques are used to identify key style influencing factors and obtain movement relationship feature data. Based on the dance state transition graph, data on key dance movements and transition frequencies is extracted. First, the timestamps and types of all dance movements are extracted from the video footage. Video analysis techniques are then used to segment continuous movements into discrete events, labeling and classifying each movement. For movement transition frequencies, the time intervals between each pair of consecutive movements are analyzed, and the number of occurrences and periodic changes of each type of transition are counted. By constructing a movement transition graph, nodes represent dance movements, edges represent transition relationships between movements, and edge weights correspond to transition frequencies. Furthermore, the correlations and sequential dependencies between dance movements are analyzed through the connection strength and patterns of the nodes. This data is used as feature input for the network, and graph network analysis techniques are used to identify key style influencing factors and obtain movement relationship feature data.

[0040] Based on the action relationship feature data, sequence analysis technology is applied to predict the transition path of dance style using the formula: ; Get dance style transition prediction data, where: represents the predicted value predicted by the dance state transition graph, and Indicates the state of continuous dance movements. 、 、 are model parameters; The benefit of the formula is that it allows the trend of dance style changes to be predicted from action relationship feature data by using the weight parameter 、 、 Adjust the impact of differentiated action states on style prediction to provide more flexible style transfer analysis; Setting parameters , , to represent the weight of the differentiated dance action state, for example, if and Represent the characteristic values ​​of two main dance states, such as modern dance and classical dance. Through this formula, the current style prediction value can be calculated. For example, and , then the predicted value ; This means that the current dance style prediction tends to be modern dance style. This result shows that by adjusting 、 、 The value of can effectively control the contribution of differentiated dance movements to style prediction, thereby optimizing the accuracy and adaptability of the style prediction model.

[0041] Integrate dance style change prediction data, combine multiple style indicators through data fusion technology, capture the movement data of various styles in dance videos, classify and organize the data, use time series analysis to identify the trend of dance style changes, match the trend data with style indicators, and use visualization tools to display the analysis results as charts to generate dance video style prediction analysis results; The dance style transition prediction data is integrated. By combining multiple style indicators through data fusion technology, the dance movement data is first matched with the historical database of dance styles to identify the style labels corresponding to each dance movement. By clustering dance movements in different time periods, the main and secondary style features are identified, and the frequency of occurrence and change patterns of the features in the dance sequence are analyzed. The style data of a single dance movement is integrated through advanced data fusion methods to form a continuous prediction of the style change of the entire dance sequence. The integrated style data is trend analyzed using time series analysis tools to determine the evolution trend of the dance style and match the trend data with style indicators. The analysis results of style changes are displayed in the form of charts using visualization tools such as advanced charts and timeline views, generating dance video style prediction analysis results. This not only assists dance choreographers in analyzing style evolution, but also provides a scientific basis for dance teaching.

[0042] The above are merely preferred embodiments of the present invention and do not limit the present invention in any other form. Any technician familiar with the profession may use the technical content disclosed above to change or modify it into an equivalent embodiment with equivalent changes and apply it to other fields. However, any simple modification, equivalent change and modification made to the above embodiment based on the technical essence of the present invention without departing from the content of the technical solution of the present invention still falls within the scope of protection of the technical solution of the present invention.

Claims

1. A multi-angle dance video analysis system, characterized in that: The system comprises: The motion capture feature extraction module is based on a multi-angle dance video dataset. It uses the Vietoris-Rips complex method to connect data points, identify spatial connection patterns in dance, extract spatial relationship data, and obtain topological network features. The motion data multi-scale analysis module applies multi-scale persistent homology analysis based on the topological network features to determine the spatial and temporal continuity of the dance motions and obtain spatial and temporal continuity results. Through the spatial and temporal continuity results, the motion patterns appearing in the differentiated dance styles are identified to obtain a basic motion pattern set. The action analysis and mapping module performs multi-dimensional scaling analysis on the actions in the multi-angle dance video based on the basic action pattern set, maps the action data to a low-dimensional space, and obtains an action mapping diagram. The action mapping diagram is used to display the similarities and differences between the dance actions, and obtain a dance action relationship diagram; The style classification and prediction module analyzes the changes and trends of dance styles based on the dance movement relationship diagram, performs state analysis on the dance movement sequence, generates a dance state transition diagram, predicts dance style changes through the dance state transition diagram, and obtains dance video style prediction analysis results.

2. The multi-angle dance video analysis system according to claim 1, characterized in that: The steps for obtaining the topological network features are specifically as follows: Based on the multi-angle dance video data set, each dance movement is analyzed and key coordinate points are extracted, and the changes of key coordinate points in time series are recorded to generate dance movement time series data; Applying the Vietoris-Rips complex method to the dance movement time series data, connecting the data points, and establishing a spatial connection graph according to a distance threshold; According to the spatial connection graph, the key connection patterns are extracted and the connectivity of multiple connection patterns is calculated using the formula: ; Get topological network features, where: represents a spatial connection graph, is the weight adjusted according to the geometric characteristics and dynamic changes of the connection points. Represents the distance between connection points. represents the attenuation coefficient, Indicators of key connectivity patterns in the spatial connectivity graph representing dance movements, Indicates the total number of connection points.

3. The multi-angle dance video analysis system according to claim 2, characterized in that: The steps for obtaining the spatial-temporal continuity result are specifically as follows: Based on the topological network characteristics, the multi-scale persistent homology analysis method is used to evaluate the topological stability of dance movements. By calculating the Betti numbers at multiple scales, the continuity of the spatial structure is identified and preliminary topological analysis results are generated. Based on the preliminary topological analysis results, the time series data of dance movements at multiple scales are analyzed, and the temporal continuity of the movements is evaluated using temporal coherence technology to generate the results of the temporal stability analysis of the movements; Combining the preliminary topological analysis results and the motion time stability analysis results, the scores of spatial and temporal data are calculated using the formula: ; Generates a spatial-temporal continuity result where Represents the score after spatial and temporal data analysis, Represents a topological complex of time and space, represents the spatial continuity score of the kth time window, represents the corresponding time continuity score, Indicates the total number of time windows.

4. The multi-angle dance video analysis system according to claim 3, characterized in that: The steps for obtaining the basic action mode set are specifically as follows: Analyzing dance data using the spatial-temporal continuity results, identifying action patterns of differentiated styles, classifying the actions through cluster analysis, and generating action pattern classification results; Analyzing the action pattern classification results, using frequent item set mining technology to capture basic action combinations appearing in the style, and generating a frequent action pattern set; Combined with the frequent action pattern set, the representativeness and difference of each pattern are calculated using the formula: ; Generate a set of basic action patterns, where Represents a set of basic action patterns, represents the frequency of occurrence of pattern z, represents the difference weight corresponding to mode z, Indicates the total number of modes.

5. The multi-angle dance video analysis system according to claim 4, characterized in that: The steps for obtaining the action map are specifically as follows: Analyze the multi-angle dance videos recorded in the basic movement pattern set, identify key movement features in multiple videos, mark the multi-dimensional attributes of each movement through statistical methods, and generate a movement feature label list; Based on the action feature label list, a multidimensional scaling analysis technique is applied to convert high-dimensional data into low-dimensional data representation to generate a low-dimensional feature mapping matrix; Based on the low-dimensional feature mapping matrix, the vector distance calculation formula is used: ; Generate an action map, where represents the spatial geometric clarity of the mapping, represents the vector position of the i-th action feature in the low-dimensional space, Represents the total action feature quantity.

6. The multi-angle dance video analysis system according to claim 5, characterized in that: The steps for obtaining the dance action relationship diagram are specifically as follows: Based on the action map, by analyzing the distance and configuration between multiple points in the map, a multidimensional scaling analysis method is applied to determine the similarities and differences between the actions, and preliminary action relationship data is obtained; The preliminary action relationship data is converted into visual coordinates through matrix transformation method, and the Euclidean distance between actions is calculated using the formula: ; Generate a distance matrix where represents the Euclidean distance between two action points in the dance action mapping graph, , represents the x and y coordinates of the action in low-dimensional space, , Represents the coordinates of another action; According to the distance matrix, a graphical algorithm is used to convert the action relationship into a visual chart, identify key and secondary action nodes, connect key action nodes to highlight the main line of the dance process, connect auxiliary secondary action nodes to refine the details of the dance action, distinguish the criticality of differentiated action nodes by color and line thickness, adjust the layout of the visual chart and optimize the display clarity of information, and generate a dance action relationship diagram.

7. The multi-angle dance video analysis system according to claim 6, characterized in that: The steps for obtaining the dance state transition diagram are specifically as follows: Extracting each action node and association from the dance action relationship graph, calculating the in-degree and out-degree of each node, each node representing an independent dance action, identifying potential connections between connectivity data actions, and generating a node association matrix; The node association matrix is ​​used to determine the transition probabilities between dance moves, and the transition probability calculation formula is applied: ; Generate an action transition probability matrix, where represents the node degree of the starting action, represents the node degree of the end action, k is the sensitivity adjustment coefficient, is the state transition probability, e represents the base of the natural logarithm; According to the action transition probability matrix, a state transition diagram is drawn using a graph theory algorithm, and the transition paths and probability sizes between differentiated dance actions are displayed to form a dance state transition diagram.

8. The multi-angle dance video analysis system according to claim 7, characterized in that: The steps for obtaining the dance video style prediction analysis results are specifically as follows: Based on the dance state transition graph, data on key dance movements and transition frequencies are extracted, and graph network analysis technology is used to identify key style influencing factors and obtain movement relationship feature data; Based on the action relationship feature data, the sequence analysis technology is applied to predict the transition path of dance style, using the formula: ; Get dance style change prediction data, where: represents the predicted value of the dance state transition diagram prediction, and Indicates the state of continuous dance movements. , , are model parameters; Integrate the dance style change prediction data, combine multiple style indicators through data fusion technology, capture the movement data of multiple styles in the dance video, classify and organize the data, use time series analysis to identify the trend of dance style changes, correspond the trend data with style indicators, and present the analysis results as charts through visualization tools to generate dance video style prediction analysis results.

Citation Information

Patent Citations

  • A physical action attribute analysis and recognition method for intelligent teaching space-time correlation

    CN109919024A

  • Method for establishing robot dance movement library based on visual processing

    CN113246147A

  • Dance motion prediction model training method, dance synthesis method, equipment and product

    CN115375806A

  • Method and device for controlling dancing of robot, electronic equipment and storage medium

    CN117428759A

  • Three-dimensional modeling attitude data processing method and system

    CN118135118A

Cited By

  • Quantitative analysis and feedback method for rhythm synchronism of sports dance training

    CN121144765A

  • A quantitative analysis and feedback method for sports dance training rhythm synchronization

    CN121144765B