A dance posture recognition and interaction method and system based on visual computing

Abstract

The present application relates to a dance posture and movement recognition and interaction method and system based on visual computing, comprising the following steps: upon receiving a recognition start command, obtaining a student's dance movement information and dance music rhythm information through a camera device; extracting the student's posture profile information at several preset moments from the dance movement information based on the dance music rhythm information; comparing the extracted posture profile information with pre-stored standard posture profile information and outputting the comparison results; based on the comparison results, screening out posture profile information with a degree of overlap with the standard posture profile information below a preset threshold, extracting the standard posture profile information corresponding to the posture profile information, generating a movement correction data packet; and sending the movement correction data packet to an interactive terminal. The present application has the effect of accurately determining whether a student's dance posture movement is standard and providing timely feedback to the student.

Description

Technical Field

[0001] The present application relates to the technical field of dance posture and movement recognition, and in particular to a dance posture and movement recognition and interaction method and system based on visual computing. Background Art

[0002] Currently, dance movement instruction is conducted through direct verbal and physical interaction between the dance teacher and the students, focusing on demonstration and correction. Students observe and imitate the teacher's movements, and the teacher then provides guidance and correction to achieve effective practice. This method requires face-to-face learning between students and teachers, and the dance teacher needs to spend a lot of time and energy to correct students' posture and movements one by one, which increases the teacher's workload. Furthermore, when there are many students, the dance teacher may find it difficult to pay attention to each student, making it difficult for students to receive timely feedback during practice. Without accurate and timely correction from professional teachers, dance practice is likely to be delayed, greatly reducing practice efficiency. Summary of the Invention

[0003] In order to accurately judge whether the dance postures and movements performed by students are standard and provide timely feedback to students, this application provides a dance posture and movement recognition and interaction method and system based on visual computing.

[0004] The above-mentioned invention objective of this application is achieved through the following technical solutions:

[0005] A dance posture and action recognition and interaction method based on visual computing, comprising the following steps:

[0006] When receiving the recognition start instruction, the student's dance movement information and dance music rhythm information are obtained through the camera device;

[0007] Based on the rhythm information of dance music, the posture contour information of students at several preset moments is extracted from the dance movement information;

[0008] Compare the extracted posture profile information with the pre-stored standard posture profile information and output the comparison results;

[0009] Based on the comparison results, the posture profile information whose overlap with the standard posture profile information is lower than a preset threshold is screened out, and the standard posture profile information corresponding to the posture profile information is extracted to generate a motion correction data packet;

[0010] The interactive terminal reads the correction data packet in real time.

[0011] By adopting the above technical solution, the student's dance movement information and the rhythm information of the dance music are obtained through the camera device, and the student's dance movement information can be obtained instantly. By comparing the standard posture contour information, the student's dance movement deviation can be accurately identified. According to the movement characteristics of each student, a personalized correction data packet is provided, which helps to teach students in accordance with their aptitude. The interactive terminal reads the correction data packet in real time, enhances the interactivity with the students, and improves the correction experience. This method realizes real-time recognition and interactive guidance of students' dance movements through visual computing technology, which can improve the efficiency and quality of dance teaching in remote teaching and independent learning scenarios.

[0012] In a preferred example of the present application, when the recognition start instruction is received, the step of obtaining the student's dance movement information and the rhythm information of the dance music through the camera device specifically includes the following steps:

[0013] When receiving the recognition start instruction, sending the dance music screening list to the interactive terminal;

[0014] For the dance music selected by the user, extract the corresponding pre-stored dance music recording and the corresponding standard dance movement information;

[0015] Using an audio device to play a dance music recording and collect rhythm information of the dance music, the rhythm information including beats in the dance music and a timestamp of each beat;

[0016] The student's dance movement information is obtained through a camera device, and the dance movement information includes all dance movement frames of the student.

[0017] By adopting the above technical solution, audio equipment is used to play dance music recordings and collect the rhythm information of the dance music, which improves the synchronization between dance movements and music rhythm, making the recognition results more accurate. Corresponding standard movement information is provided for the dance music selected by the user, which enhances the pertinence and standardization of teaching content. All dance movement frames are collected to improve the integrity of movement information, which helps to comprehensively analyze students' dance posture performance.

[0018] In a preferred example of the present application, the step of extracting the posture contour information of the student at a plurality of preset moments from the dance movement information based on the rhythm information of the dance music specifically includes the following steps:

[0019] Based on the rhythm information of the dance music and the standard dance movement information, the timestamp of the beat corresponding to each standard movement frame is marked;

[0020] According to several key postures in the preset dance movements, obtain the standard action frames corresponding to the several key postures and output the timestamps of the corresponding beats;

[0021] Based on the output beat timestamp, the dance action frame corresponding to the student at the timestamp is extracted from the dance action information;

[0022] Posture contour information is output based on the extracted dance action frames, and standard posture contour information is output based on the standard action frames.

[0023] By adopting the above technical solution, standard action frames corresponding to several key postures are obtained, and the timestamps of the corresponding beats are output, thereby realizing standardized analysis of dance movements. Focusing on key postures helps to quickly locate the main problems in dance movements, and extracting corresponding dance movement frames based on timestamps improves the accuracy of posture contour information extraction. This method realizes accurate analysis of students' key dance movements by marking and extracting key postures.

[0024] In a preferred embodiment of the present application, the step of comparing the extracted posture profile information with the pre-stored standard posture profile information and outputting the comparison result specifically includes the following steps:

[0025] Preset personalized body proportion models for students and store them in the interactive terminal;

[0026] Extracting the body proportion model of the corresponding student according to the user identity information sent by the interactive terminal;

[0027] Dynamically adjust the standard posture contour information based on the body proportion model, and correct the standard posture contour information through automatic scaling and deformation;

[0028] The extracted posture profile information is compared with the corrected standard posture profile information, and the coincidence data of the two is output.

[0029] By adopting the above technical solution, the standard posture is adjusted according to the student's body proportion model, making the action recognition more in line with individual characteristics. Through automatic scaling and deformation, the accuracy of matching the standard posture contour information with the actual action is improved. It can adapt to students with different physical characteristics, improve the universal applicability of the action recognition system, and reduce the possibility of misjudgment due to the different body proportions of the students and the standard posture contour.

[0030] In a preferred embodiment of the present application, the step of dynamically adjusting the standard posture contour information based on the body proportion model and correcting the standard posture contour information by automatic scaling and deformation specifically includes the following steps:

[0031] Identify key body parts in a scale model of the student's body, including the head, neck, shoulders, elbows, wrists, hips, knees, and ankles;

[0032] Extract the three-dimensional coordinates of each key body part, calculate the distance ratio between each three-dimensional coordinate, and output the scale correction parameter;

[0033] According to the scale correction parameters, the standard posture contour information is corrected by automatic scaling and deformation, and the corrected standard posture contour information is output.

[0034] By adopting the above technical solution, the standard posture contour is corrected according to the individual body proportions, so that the standard posture contour information is more consistent with the student's actual body shape, reducing the possibility of misjudgment due to the different body proportions between the student and the standard posture contour.

[0035] In a preferred example of the present application, the steps of screening out posture profile information whose overlap with the standard posture profile information is lower than a preset threshold based on the comparison results, extracting the standard posture profile information corresponding to the posture profile information, and generating a motion correction data packet specifically include the following steps:

[0036] When the coincidence data between the posture profile information and the corrected standard posture profile information is lower than a preset threshold, the posture profile information is associated with a correction identifier;

[0037] Based on the posture contour information with correction marks, extract the corresponding standard posture contour information;

[0038] Analyze the difference between the posture profile information and the standard posture profile information, and output correction prompt information, including deviations in position, angle, movement range, etc.;

[0039] Pack the correction prompt information to generate a correction data packet.

[0040] By adopting the above technical solution, correction is performed on posture contour information with low overlap, which improves the targeted nature of the correction. Through correction prompt information, the specific aspects that students need to improve, such as position, angle, movement amplitude, etc., are clarified. The generated correction data packet can be directly used to guide students to improve their dance movements, thereby improving the efficiency of correction.

[0041] In a preferred embodiment of the present application, when the coincidence data between the posture profile information and the corrected standard posture profile information is lower than a preset threshold, after the step of associating the posture profile information with the correction identifier, the step further includes:

[0042] The speed of generating correction marks is recorded in real time during the playing of dance music;

[0043] When the speed of generating the correction mark is greater than the preset threshold, the music playback is automatically stopped and a repeat practice confirmation request is sent to the interactive terminal;

[0044] The user selects whether to restart the dance movement practice based on the repeat practice confirmation request;

[0045] After receiving the repeat practice instruction from the interactive terminal, all correction marks are cleared and the music is played from the beginning.

[0046] By adopting the above technical solution, the speed of correction mark generation is recorded in real time, and the teaching process can be dynamically adjusted. When the speed of correction mark generation is greater than the preset threshold, it means that the student has too many posture problems when the dance reaches the current progress. At this time, there is little point in continuing to practice. It is necessary to practice the previous part repeatedly. By sending a repeat practice confirmation request, students are allowed to choose whether to repeat the practice according to the actual situation, which improves the flexibility and effectiveness of teaching.

[0047] The second object of the present invention is achieved through the following technical solutions:

[0048] A dance posture and motion recognition and interaction system based on visual computing, comprising:

[0049] The recognition module is used to obtain the student's dance movement information and dance music rhythm information through the camera device when receiving the recognition start instruction;

[0050] An extraction module is used to extract the student's posture contour information at a number of preset moments from the dance movement information based on the rhythm information of the dance music;

[0051] A comparison module is used to compare the extracted posture profile information with the pre-stored standard posture profile information and output the comparison result;

[0052] The feedback module is used to screen out posture profile information whose overlap with the standard posture profile information is lower than a preset threshold based on the comparison results, extract the standard posture profile information corresponding to the posture profile information, generate a motion correction data packet, and send the motion correction data packet to the interactive terminal.

[0053] By adopting the above technical solutions, each module works together to form a complete dance posture and movement recognition and interaction system.

[0054] The third objective of this application is achieved through the following technical solutions:

[0055] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above-mentioned dance posture and action recognition and interaction method based on visual computing are implemented.

[0056] The fourth objective of this application is achieved through the following technical solutions:

[0057] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the above-mentioned dance posture and action recognition and interaction method based on visual computing.

[0058] In summary, this application includes at least one of the following beneficial technical effects:

[0059] 1. By capturing student dance movement information and dance music rhythm information through a camera, students' dance movement information can be instantly acquired. By comparing it with standard posture contour information, students' dance movement deviations can be accurately identified. Based on each student's movement characteristics, personalized correction data packets are provided, which helps to teach students in accordance with their aptitude. The interactive terminal reads the correction data packets in real time, enhancing the interaction with students and improving the correction experience. This method realizes real-time recognition and interactive guidance of students' dance movements through visual computing technology, which can improve the efficiency and quality of dance teaching in remote teaching and self-study scenarios.

[0060] 2. Obtaining standard action frames corresponding to several key postures and outputting the corresponding beat timestamps achieves standardized analysis of dance movements. Focusing on key postures helps quickly locate major problems in dance movements. Extracting corresponding dance movement frames based on timestamps improves the accuracy of posture contour information extraction. By marking and extracting key postures, this method achieves accurate analysis of students' key dance movements.

[0061] 3. The standard posture is adjusted based on the student's body proportion model, making motion recognition more personalized. Through automatic scaling and deformation, the accuracy of matching the standard posture outline information with the actual movement is improved. This can adapt to students with different physical characteristics, improve the universal applicability of the motion recognition system, and reduce the possibility of misjudgment due to differences in body proportions between students and the standard posture outline.

[0062] 4. Real-time recording of the speed at which correction marks are generated enables dynamic adjustment of the teaching process. When the speed at which correction marks are generated is greater than a preset threshold, it indicates that the student has too many posture problems at the current stage of the dance. At this point, there is little point in continuing to practice, and it is necessary to practice the previous part repeatedly. By sending a repeat practice confirmation request, students can choose whether to repeat the practice based on the actual situation, thereby improving the flexibility and effectiveness of teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 This is a flow chart of an embodiment of a dance posture and movement recognition, interaction method and system based on visual computing of the present application;

[0064] Figure 2This is a flowchart of step S10 in an embodiment of a dance posture and action recognition and interaction method and system based on visual computing of the present application;

[0065] Figure 3 This is a flowchart of step S20 in an embodiment of a dance posture and action recognition and interaction method and system based on visual computing of the present application;

[0066] Figure 4 This is a schematic diagram of a dance posture and action recognition and interaction system based on visual computing in this application;

[0067] Figure 5 This is a principle block diagram of a computer device of the present application. DETAILED DESCRIPTION

[0068] The present application is further described in detail below with reference to the accompanying drawings.

[0069] In the following embodiments, Figure 1-3 As shown, the present application discloses a dance posture and action recognition and interaction method based on visual computing, which specifically includes the following steps:

[0070] S10: When the recognition start instruction is received, the student's dance movement information and the rhythm information of the dance music are acquired through the camera device;

[0071] S20: extracting the student's posture contour information at a plurality of preset moments from the dance movement information based on the rhythm information of the dance music;

[0072] S30: comparing the extracted posture profile information with pre-stored standard posture profile information, and outputting the comparison result;

[0073] S40: Based on the comparison result, screen out posture profile information whose overlap with the standard posture profile information is lower than a preset threshold, extract the standard posture profile information corresponding to the posture profile information, and generate a motion correction data packet;

[0074] S50: The interactive terminal reads the correction data packet in real time.

[0075] In this embodiment, the preset moments are usually key frames of dance movements, which are particularly important for the accuracy and style of the movements. The standard posture contour information is usually recorded by professional dance teachers to ensure its accuracy and standardization. The movement correction data package includes videos, pictures, and text descriptions of the standard movements.

[0076] Specifically, the students' dance movements are captured by a camera device, and the audio equipment collects the rhythm information of the dance music. The image processing technology is used to extract the outline of the students' dance movements at a preset moment from the video sequence. The outline information of the movement is obtained through edge detection, skeleton extraction and other methods. The extracted movement outline is compared with the pre-stored standard dance movement outline. The student's dance posture is evaluated by calculating the overlap ratio of the overall outline and the overlap of some important outlines. The higher the overlap ratio, the closer the student's movement is to the standard movement. Real-time feedback and correction prompts are provided to students through interactive terminals (such as screens, tablets, etc.). The correction prompts can be in the form of visual marks, text descriptions or audio prompts.

[0077] In one embodiment, step S10 specifically includes the following steps:

[0078] S11: When receiving the recognition start instruction, sending the dance music screening list to the interactive terminal;

[0079] S12: extracting corresponding pre-stored dance music recordings and corresponding standard dance movement information for the dance music selected by the user;

[0080] S13: using an audio device to play a dance music recording and collect rhythm information of the dance music, where the rhythm information includes beats in the dance music and a timestamp of each beat;

[0081] S14: Acquire the student's dance movement information through a camera device, where the dance movement information includes all dance movement frames of the student.

[0082] In this embodiment, the dance music filter table includes various dance music options and related information. Users can select appropriate music according to their needs. The timestamp is used to mark the specific time point when each beat occurs during the music playback process.

[0083] Specifically, when the system receives the recognition start instruction, it will send a dance music filter table to the interactive terminal (such as a tablet computer, smart phone, etc.). After the user selects specific dance music on the interactive terminal, the system will extract the corresponding pre-stored dance music recording and the corresponding standard dance movement information according to the user's selection. These standard movement information are usually dance movements performed by professional dancers, which have been pre-recorded and stored in the system as a reference standard for dance movements. In the dance movements captured by the video, the dance movement frames corresponding to each beat are marked according to the timestamp obtained by analyzing the music rhythm. In this way, each dance movement is associated with a specific beat in the music. While the music is playing, the camera device starts to capture the student's dance movements, including all the student's dance movement frames, that is, continuous dance movement pictures or video frames. These movement frames will be used to extract the student's posture contour information at a specific moment for comparison in subsequent steps.

[0084] In one embodiment, step S20 specifically includes the following steps:

[0085] S21: Based on the rhythm information of the dance music and the standard dance movement information, mark the timestamp of the beat corresponding to each standard movement frame;

[0086] S22: according to a plurality of key postures in a preset dance movement, obtaining standard action frames corresponding to the plurality of key postures, and outputting the timestamps of the corresponding beats;

[0087] S23: extracting the student's dance action frame corresponding to the timestamp from the dance action information based on the output beat timestamp;

[0088] S24: Outputting posture contour information based on the extracted dance action frames, and outputting standard posture contour information based on the standard action frames.

[0089] In this embodiment, key postures are usually representative movements in a dance and are crucial for evaluating the overall performance of the dance. Posture profile information may be key point positions and body curves of the dancer's body.

[0090] Specifically, according to the rhythm information of the dance music and the pre-stored standard dance movement information, a corresponding beat timestamp is marked for each standard action frame, so that each standard action frame is associated with a specific beat in the music, ensuring the synchronization of the dance movement and the music rhythm. According to several key postures in the preset dance movements, the standard action frames corresponding to these key postures are screened out from the standard dance movement information, and the beat timestamps corresponding to these key postures are output. The beat timestamps output in step S22 are used to extract the dance movement frames corresponding to these timestamps from the student dance movement information. These extracted action frames will be used to compare with the standard action frames to evaluate the student's dance performance. Based on the extracted student dance movement frames, the student's posture contour information is output, and at the same time, the corresponding standard posture contour information is output based on the standard action frames.

[0091] In one embodiment, step S30 specifically includes the following steps:

[0092] S31: Preset a personalized body proportion model for the student and store it in the interactive terminal;

[0093] S32: extracting a body proportion model of the corresponding student based on the user identity information sent by the interactive terminal;

[0094] S33: dynamically adjusting the standard posture contour information based on the body proportion model, and correcting the standard posture contour information by automatic scaling and deformation;

[0095] S34: Compare the extracted posture profile information with the corrected standard posture profile information, and output the coincidence data between the two.

[0096] In this embodiment, the student's body size data is obtained in advance through three-dimensional scanning or manual input.

[0097] Specifically, personalized body proportion models are preset for students to improve the accuracy of posture comparison. When posture comparison is required, the interactive terminal will send the user's identity information, and extract the corresponding student's personalized body proportion model based on this information, so as to use a model that matches the student's body shape to compare the posture contours. Based on this model, the standard posture contour information is dynamically adjusted, which includes automatically scaling and deforming the standard posture contour information to match the student's physical characteristics. The extracted student posture contour information is compared with the corrected standard posture contour information. The result of the comparison is to output the overlap data of the two. These data reflect the similarity between the student's dance movements and the standard movements. The overlap data can be used to evaluate the student's dance performance and guide subsequent movement correction.

[0098] In one embodiment, step S33 specifically includes the following steps:

[0099] S331: Identify key body parts in a scale model of the student body, including the head, neck, shoulders, elbows, wrists, hips, knees, and ankles;

[0100] S332: extracting the three-dimensional coordinates of each key body part, calculating the ratio of the distances between the three-dimensional coordinates, and outputting a ratio correction parameter;

[0101] S333: Correcting the standard posture contour information by automatic scaling and deformation according to the scale correction parameter, and outputting the corrected standard posture contour information.

[0102] In this embodiment, the standard posture is adjusted according to the student's body proportion model so that the action recognition is more in line with individual characteristics. Through automatic scaling and deformation, the accuracy of matching the standard posture contour information with the actual action is improved. It can adapt to students with different physical characteristics, improve the universal applicability of the action recognition system, and reduce the possibility of misjudgment due to the different body proportions of the student and the standard posture contour.

[0103] Specifically, key body parts in the student's body proportion model are identified, which usually include the head, neck, shoulders, elbows, wrists, hips, knees and ankles, etc. The three-dimensional coordinates of the above key body parts are extracted to represent the position of each key part in the three-dimensional space, and the ratio of the distances between these three-dimensional coordinates is calculated. These ratios reflect the relative proportions between the various parts of the student's body. Based on these ratios, proportion correction parameters are output. The proportion correction parameters will be used to adjust the standard posture contour information to adapt to the student's physical characteristics. According to the calculated proportion correction parameters, the standard posture contour information is corrected by automatic scaling and deformation. This process ensures that the standard posture contour information matches the student's actual body proportions. The corrected standard posture contour information will more accurately reflect the student's proper dance posture, thereby improving the accuracy of posture comparison and movement correction.

[0104] In one embodiment, step S40 specifically includes the following steps:

[0105] S41: when the coincidence data between the posture profile information and the corrected standard posture profile information is lower than a preset threshold, associating the posture profile information with a correction identifier;

[0106] S42: extracting corresponding standard posture contour information based on the posture contour information with the correction mark;

[0107] S43: Analyze the difference between the posture profile information and the standard posture profile information, and output correction prompt information, including deviations in position, angle, movement range, etc.;

[0108] S44: Pack the correction prompt information to generate a correction data packet.

[0109] In this embodiment, the correction prompt information gives specific improvement suggestions, such as "the knees should be bent more" or "the arms should be stretched more when raised". When the students dance, the system monitors in real time and gives instant feedback to help students adjust their movements immediately. After the students finish the dance, a complete feedback report is provided, allowing students to review and analyze their performance. A practice mode is provided, allowing students to repeatedly practice specific movements based on feedback until they reach the standard.

[0110] Specifically, the posture contour information is compared with the corrected standard posture contour information. When the overlap data between them is lower than a preset threshold, the posture contour information is marked with a correction mark. Based on the posture contour information with the correction mark, the corresponding standard posture contour information is extracted. The differences between the posture contour information with the correction mark and the corresponding standard posture contour information are analyzed. These differences may include deviations in position, angle, movement amplitude, etc. Specific correction prompt information is output based on these differences. These prompt information will guide students on how to adjust their dance movements to meet the standards. All correction prompt information is packaged to generate a correction data packet. This data packet contains all the information that students need to correct in specific dance movements, which can be provided to teachers and students in real time through interactive terminals for immediate movement correction and training.

[0111] In one embodiment, after step S41, the following steps are further included:

[0112] S411: Recording the speed of generating the correction mark in real time during the playing of the dance music;

[0113] S412: When the speed of generating the correction mark is greater than a preset threshold, the music playback is automatically stopped and a repeat practice confirmation request is sent to the interactive terminal;

[0114] S413: The user selects whether to restart the dance movement practice based on the repeat practice confirmation request;

[0115] S414: After receiving the repeat practice instruction from the interactive terminal, all correction marks are cleared and the music is played from the beginning.

[0116] In this embodiment, the speed of generating correction marks is recorded in real time, and the teaching process can be dynamically adjusted. When the speed of generating correction marks is greater than a preset threshold, it means that the student has too many posture problems when the dance reaches the current progress. At this time, there is little point in continuing to practice, and it is necessary to practice the previous part repeatedly. By sending a repeat practice confirmation request, students are allowed to choose whether to repeat the practice according to the actual situation, thereby improving the flexibility and effectiveness of teaching.

[0117] Specifically, when the overlap data between the posture contour information and the corrected standard posture contour information is lower than a preset threshold, the posture contour information is associated with a correction mark. During the playing of dance music, the speed of generating the correction mark is recorded in real time. This speed indicator reflects the frequency of incorrect movements made by students during the dance process. If it is detected that the speed of generating the correction mark is greater than the preset threshold, this means that the student has made multiple incorrect movements in a short period of time. At this time, the music playback is automatically stopped, and a repeat practice confirmation request is sent to the interactive terminal, prompting the student that they may need to practice again. The user (student or teacher) will choose whether to restart the dance movement practice based on the repeat practice confirmation request received by the interactive terminal. When the repeat practice instruction is received from the interactive terminal, all previous correction marks will be cleared and the music will be played from the beginning. These steps together constitute a closed-loop feedback and correction system that can monitor students' performance in real time and provide instant feedback and practice guidance, thereby optimizing the dance learning process.

[0118] In addition, when the interactive terminal receives a confirmation request for repeated practice, the user can also choose to re-read the movement correction data package according to needs, perform intensive practice on non-standard movements, or choose to open the dance music filter list to switch to other dances, or choose to continue the current dance practice.

[0119] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0120] In one embodiment, a dance posture and movement recognition and interaction system based on visual computing is provided. The device corresponds to a dance posture and movement recognition and interaction method based on visual computing in the above embodiment. Figure 4 As shown, the system includes:

[0121] The recognition module is used to obtain the student's dance movement information and dance music rhythm information through the camera device when receiving the recognition start instruction;

[0122] An extraction module is used to extract the student's posture contour information at a number of preset moments from the dance movement information based on the rhythm information of the dance music;

[0123] A comparison module is used to compare the extracted posture profile information with the pre-stored standard posture profile information and output the comparison result;

[0124] The feedback module is used to screen out posture profile information whose overlap with the standard posture profile information is lower than a preset threshold based on the comparison results, extract the standard posture profile information corresponding to the posture profile information, generate a motion correction data packet, and send the motion correction data packet to the interactive terminal.

[0125] The specific definition of a dance gesture recognition and interaction system based on visual computing can be found in the definition of a dance gesture recognition and interaction method based on visual computing above, and will not be repeated here. The various modules in the above-mentioned dance gesture recognition and interaction system based on visual computing can be implemented in whole or in part through software, hardware, or a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in hardware form, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of the above-mentioned modules.

[0126] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 5 As shown. The computer device includes a processor, memory, network interface, and database connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a dance posture and movement recognition and interaction method based on visual computing is implemented.

[0127] In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, a dance posture and action recognition and interaction method based on visual computing is implemented;

[0128] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, a dance posture and action recognition and interaction method based on visual computing is implemented.

[0129] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0130] Those skilled in the art will clearly understand that for the sake of convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by several functional units and modules as needed, that is, the internal structure of the device can be divided into several functional units or modules to complete all or part of the functions described above.

[0131] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A dance posture and action recognition and interaction method based on visual computing, characterized in that: Including steps: When a recognition start instruction is received, a dance music screening list is sent to the interactive terminal; for the dance music recording selected by the user, the corresponding pre-stored dance music recording and the corresponding standard dance movement information are extracted; the dance music recording is played using an audio device and the rhythm information of the dance music is collected, the rhythm information including the beats in the dance music and the timestamp of each beat; the dance movement information of the student is obtained through a camera device, the dance movement information including all dance movement frames of the student; Based on the rhythm information of dance music, the posture contour information of students at several preset moments is extracted from the dance movement information; Preset a personalized body proportion model for the student and store it in the interactive terminal; extract the corresponding student's body proportion model based on the user identity information sent by the interactive terminal; dynamically adjust the standard posture contour information based on the body proportion model, and modify the standard posture contour information by automatically scaling and deforming it; compare the extracted posture contour information with the pre-stored standard posture contour information, and output the comparison results; Based on the comparison results, the posture contour information having a degree of overlap with the standard posture contour information lower than a preset threshold is screened out, and the posture contour information is associated with a correction mark; Based on the posture contour information with correction marks, the corresponding standard posture contour information is extracted, the difference between the posture contour information and the standard posture contour information is analyzed, and correction prompt information is output, including deviations in position, angle, and movement amplitude, to generate a movement correction data packet; The interactive terminal reads the correction data packet in real time; During the playback of dance music recordings, the speed at which correction marks are generated is recorded in real time; when the speed at which correction marks are generated is greater than a preset threshold, the music playback is automatically stopped and a repeat practice confirmation request is sent to the interactive terminal; the user chooses whether to restart the dance movement practice based on the repeat practice confirmation request; after receiving the repeat practice instruction sent by the interactive terminal, all correction marks are cleared and the music is played from the beginning.

2. The dance posture and movement recognition and interaction method based on visual computing according to claim 1 is characterized in that: The step of extracting the student's posture contour information at a plurality of preset moments from the dance movement information based on the rhythm information of the dance music specifically comprises the following steps: Based on the rhythm information of the dance music and the standard dance movement information, the timestamp of the beat corresponding to each standard movement frame is marked; According to several key postures in the preset dance movements, obtain the standard action frames corresponding to the several key postures and output the timestamps of the corresponding beats; Based on the output beat timestamp, the dance action frame corresponding to the student at the timestamp is extracted from the dance action information; Posture contour information is output based on the extracted dance action frames, and standard posture contour information is output based on the standard action frames.

3. The dance posture and movement recognition and interaction method based on visual computing according to claim 1 is characterized in that: The step of comparing the extracted plurality of posture profile information with pre-stored standard posture profile information and outputting the comparison result comprises: The extracted posture profile information is compared with the corrected standard posture profile information, and the coincidence data of the two is output.

4. The dance posture and movement recognition and interaction method based on visual computing according to claim 1 is characterized in that: The step of dynamically adjusting the standard posture contour information based on the body proportion model and correcting the standard posture contour information by automatic scaling and deformation specifically includes the following steps: Identify key body parts in a scale model of the student's body, including the head, neck, shoulders, elbows, wrists, hips, knees, and ankles; Extract the three-dimensional coordinates of each key body part, calculate the distance ratio between each three-dimensional coordinate, and output the scale correction parameter; According to the scale correction parameters, the standard posture contour information is corrected by automatic scaling and deformation, and the corrected standard posture contour information is output.

5. A dance posture recognition and interaction system based on visual computing, characterized in that: include: The recognition module is used to send a dance music screening list to the interactive terminal when receiving a recognition start instruction; For the dance music recording selected by the user, the corresponding pre-stored dance music recording and the corresponding standard dance movement information are extracted; the dance music recording is played using an audio device and the rhythm information of the dance music is collected, the rhythm information including the beats in the dance music and the timestamp of each beat; the dance movement information of the student is obtained through a camera device, the dance movement information including all dance movement frames of the student; An extraction module is used to extract the student's posture contour information at a number of preset moments from the dance movement information based on the rhythm information of the dance music; The comparison module is used to preset a personalized body proportion model for the student and store it in the interactive terminal; extract the corresponding student's body proportion model based on the user identity information sent by the interactive terminal; dynamically adjust the standard posture contour information based on the body proportion model, and modify the standard posture contour information by automatically scaling and deforming it; compare the extracted posture contour information with the pre-stored standard posture contour information, and output the comparison results; A feedback module is used to screen out posture profile information whose overlap with the standard posture profile information is lower than a preset threshold based on the comparison result, and associate the posture profile information with a correction identifier; Based on the posture contour information with correction marks, the corresponding standard posture contour information is extracted, the difference between the posture contour information and the standard posture contour information is analyzed, and correction prompt information is output, including deviations in position, angle, and movement amplitude, to generate a movement correction data packet; The interactive terminal reads the correction data packet in real time; During the playback of dance music recordings, the speed at which correction marks are generated is recorded in real time; when the speed at which correction marks are generated is greater than a preset threshold, the music playback is automatically stopped and a repeat practice confirmation request is sent to the interactive terminal; the user chooses whether to restart the dance movement practice based on the repeat practice confirmation request; after receiving the repeat practice instruction sent by the interactive terminal, all correction marks are cleared and the music is played from the beginning.

6. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the dance posture and action recognition and interaction method based on visual computing as described in any one of claims 1 to 4 are implemented.

7. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the dance posture and action recognition and interaction method based on visual computing as described in any one of claims 1 to 4 are implemented.

Images