Dance teaching method and system

Abstract

The invention discloses a dance teaching method and system, and the method comprises the steps: receiving a dance teaching video transmitted by a dance teacher terminal and dance practice data uploaded by a dance student terminal, and extracting a key frame in the teaching video, coordinates of each joint point in the key frame, and acceleration values of limb parts; coordinate values and acceleration values in the exercise data are converted and then matched with the key frames, the acceleration difference values of all the limb parts in the exercise data during dance movement are calculated, correct virtual dance movement of all the limb parts presented by a virtual object is generated based on the virtual reality technology, and the virtual dance movement of all the limb parts is obtained. And returning the virtual dance movement to the dance student terminal, and superposing the virtual dance movement with a corresponding dance movement in the dance practice video of the dance student. According to the invention, the dance trainee can quickly master the limb moving speed during switching of different actions in dance, and the online dance teaching quality and efficiency are improved.

Description

Technical Field

[0001] The present application relates to the technical field of teaching systems, and in particular to a dance teaching method and system. Background Art

[0002] With the development of Internet technology, many dance teaching also uses Internet technology to achieve online teaching. In dance teaching, dance movements (including postures and body movement speed), time nodes and expressions are important factors that determine whether the dance is beautiful, and are also the focus of dance teaching. In particular, the speed of body movement is a difficult point in dance teaching. For example, many people imitate Michael Jackson's dance, but most people can only imitate his basic movements, but it is difficult to master the beauty expressed by the power in the dance movements. This is because they have not mastered the speed of body movement when switching between different movements in the dance. In online dance teaching, this teaching difficulty will be further magnified, and therefore it has become an important factor hindering the development and application of online dance teaching. Summary of the invention

[0003] In view of the above problems, the present application provides a dance teaching method and system to solve the technical problems existing in the above-mentioned online dance teaching.

[0004] To achieve the above purpose, the present application provides a dance teaching method, comprising the following steps: Receiving a dance teaching video sent by a dance teacher terminal, wherein the teaching video includes a reference ruler of standard length; establishing a three-dimensional coordinate system according to the reference ruler and calculating a height parameter of the dance teacher in the teaching video; Selecting joints of the dance teacher's body in the teaching video, and marking two or more adjacent joints as associated joints of the same limb according to the limbs of the human body; The teaching video is decomposed into frames and compared with adjacent frames to obtain a plurality of key frames whose coordinate offsets of the joint points are greater than a preset value; the timestamps of the key frames and the coordinate values ​​of each of the joint points are recorded; the time interval between two adjacent key frames is obtained according to the timestamps, and the acceleration values ​​of the limb parts in different key frames are calculated in combination with the changes in the coordinate values ​​of the associated joint points, and marked as the first acceleration values; the first acceleration values ​​of the limb parts, the timestamps of the key frames, and the coordinate values ​​of the joint points are integrated to generate a dance teaching file; Receive dance practice data uploaded by a dance student terminal, the practice data including a height parameter of the dance student, and position information of each joint and a second acceleration value of each limb part of the dance student during the dance practice, the position information of each joint and the second acceleration value are collected by wearing a position sensor on each joint of the dance student and performing dance practice; Based on the height parameter of the dance teacher and the height parameter of the dance student, a transformation ratio is obtained, and the position information of each joint of the dance student and the second acceleration value are respectively multiplied by the transformation ratio to obtain corresponding third position information and third acceleration value; Calculating dance movements at different moments in the practice data based on the third position information of each joint, and matching the dance movements with the coordinate values ​​of each joint point in the dance teaching file to obtain the key frames in the dance teaching file corresponding to the dance movements at different moments in the practice data; Calculating each acceleration difference between the third acceleration value of each dance action and the first acceleration value of each corresponding key frame; obtaining a dance action speed modification positive value of each limb part based on the acceleration difference; combining the practice data and the dance action speed modification positive value, and generating a correct virtual dance action of each limb part presented by a virtual object based on virtual reality technology; The virtual dance movements are returned to the terminal of the dance student, and the virtual dance movements are superimposed with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

[0005] In order to solve the above technical problems, this application also provides another technical solution: A dance teaching system, comprising: A dance teacher terminal is used to send a dance teaching video, wherein the teaching video includes a reference ruler of standard length; establish a three-dimensional coordinate system according to the reference ruler and calculate the height parameter of the dance teacher in the teaching video; A dance student terminal, used for uploading dance practice data, wherein the practice data includes a height parameter of the dance student, and position information of each joint and a second acceleration value of each limb part of the dance student during dance practice, wherein the position information of each joint and the second acceleration value are collected by wearing position sensors on each joint of the dance student and performing dance practice; The service terminal is used to select the joints of the dance teacher's body in the teaching video, and mark two or more adjacent joints as associated joints of the same limb according to the limbs of the human body; The teaching video is decomposed into frames and compared with adjacent frames to obtain a plurality of key frames whose coordinate offsets of the joint points are greater than a preset value; the timestamps of the key frames and the coordinate values ​​of each of the joint points are recorded; the time interval between two adjacent key frames is obtained according to the timestamps, and the acceleration values ​​of the limb parts in different key frames are calculated in combination with the changes in the coordinate values ​​of the associated joint points, and marked as the first acceleration values; the first acceleration values ​​of the limb parts, the timestamps of the key frames, and the coordinate values ​​of the joint points are integrated to generate a dance teaching file; Based on the height parameter of the dance teacher and the height parameter of the dance student, a transformation ratio is obtained, and the position information of each joint of the dance student and the second acceleration value are respectively multiplied by the transformation ratio to obtain corresponding third position information and third acceleration value; Calculating dance movements at different moments in the practice data based on the third position information of each joint, and matching the dance movements with the coordinate values ​​of each joint point in the dance teaching file to obtain the key frames in the dance teaching file corresponding to the dance movements at different moments in the practice data; Calculating the acceleration differences between the third acceleration value of each dance action and the first acceleration value of each corresponding key frame; obtaining the dance action speed modification positive value of each limb part based on the acceleration difference; combining the practice data and the dance action speed modification positive value, and generating the correct virtual dance action of each limb part presented by a virtual object based on virtual reality technology; and returning the virtual dance action to the dance student terminal; The dance student terminal is also used to superimpose the virtual dance movements with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

[0006] Different from the prior art, the above technical scheme can calculate the acceleration value of the limbs during the dance action from the change of the coordinate value of the associated joint point in the dance teaching video, and generate a dance teaching file including the first acceleration value, the timestamp of the key frame, and the coordinate value of the joint point; and based on the third position information of each joint, the key frame corresponding to the dance action at different times in the practice data can be calculated to achieve the action matching of each dance action in the teaching video with the practice data; and the transformation ratio is obtained according to the height parameter difference between the teacher and the student, so as to overcome the influence of the height difference, accurately obtain the acceleration difference between each limb and the normal dance action, and the acceleration difference represents the difference in the speed of limb movement when different dance actions are switched; and based on virtual reality technology, the correct virtual dance action of each limb presented by a virtual object is generated, so that each dance action and the corresponding virtual dance action are displayed in layers in the dance practice video. So that dance students can intuitively see the dance action of each limb and the correct virtual dance action corresponding to each limb, so that dance students can quickly master the speed of limb movement when different actions are switched in the dance, and improve the quality and efficiency of online dance teaching.

[0007] The above-mentioned records related to the invention content are only an overview of the technical solution of the present application. In order to enable ordinary technicians in the field to more clearly understand the technical solution of the present application, and then implement it according to the text of the specification and the contents recorded in the drawings, and to make the above-mentioned purpose and other purposes, features and advantages of the present application easier to understand, the following is an explanation in combination with the specific implementation mode and drawings of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The drawings are only used to illustrate the principles, implementation methods, applications, characteristics and effects of the specific embodiments of the present invention and other related contents, and shall not be considered as limiting the present application.

[0009] In the drawings of the specification: Figure 1 A flowchart of the dance teaching method described in the specific implementation method; Figure 2 A flowchart for generating correct virtual dance movements of limb parts in a specific implementation manner; Figure 3 A flowchart of superimposed display of virtual dance movements and dance practice videos according to a specific implementation method; Figure 4 It is a module block diagram of the dance teaching system described in the specific implementation method.

[0010] The reference numerals in the above drawings are described as follows: 400. Dance teaching system; 401. Dance teacher terminal; 402. Dance student terminal; 403. Service terminal. DETAILED DESCRIPTION

[0011] In order to explain in detail the possible application scenarios, technical principles, specific schemes that can be implemented, and the purposes and effects that can be achieved, the following is a detailed description of the specific embodiments listed in conjunction with the accompanying drawings. The embodiments described herein are only used to more clearly illustrate the technical solutions of the present application, and are therefore only used as examples, and cannot be used to limit the scope of protection of the present application.

[0012] Reference to "embodiment" herein means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The term "embodiment" appearing in various places in the specification does not necessarily refer to the same embodiment, nor does it particularly limit its independence or association with other embodiments. In principle, in the present application, as long as there is no technical contradiction or conflict, the various technical features mentioned in the embodiments can be combined in any way to form a corresponding implementable technical solution.

[0013] Unless otherwise defined, the technical terms used in this document have the same meanings as those generally understood by those skilled in the art to which this application belongs; the use of relevant terms in this document is only for describing specific embodiments and is not intended to limit this application.

[0014] In the description of this application, the term "and / or" is an expression used to describe the logical relationship between objects, indicating that three relationships may exist, for example, A and / or B, which means: A exists, B exists, and A and B exist at the same time. In addition, the character " / " in this article generally indicates that the objects before and after are in an "or" logical relationship.

[0015] In the present application, terms such as “first” and “second” are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship of quantity, priority or sequence between these entities or operations.

[0016] Without further limitations, in this application, the words "include", "comprises", "has" or other similar open-ended expressions used in sentences are intended to cover non-exclusive inclusion. These expressions do not exclude the presence of additional elements in the process, method or product including the elements, so that the process, method or product including a series of elements may include not only those limited elements, but also other elements not explicitly listed, or also include elements inherent to such process, method or product.

[0017] Similar to the understanding in the Examination Guidelines, in this application, expressions such as "greater than", "less than", "exceed" and the like are understood to exclude the number itself; expressions such as "above", "below", "within" and the like are understood to include the number itself. In addition, in the description of the embodiments of this application, "multiple" means more than two (including two), and similar expressions related to "multiple" are also understood in this way, such as "multiple groups", "multiple times", etc., unless otherwise clearly and specifically limited.

[0018] In the description of the embodiments of the present application, space-related expressions used, such as "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "vertical", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc., indicate the orientation or position relationship based on the orientation or position relationship shown in the specific embodiments or drawings, and are only for the convenience of describing the specific embodiments of the present application or facilitating the reader's understanding, and do not indicate or imply that the referred device or component must have a specific position, a specific orientation, or be constructed or operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.

[0019] Unless otherwise expressly specified or limited, in the description of the embodiments of the present application, the terms such as "install", "connect", "connect", "fix", "set", etc. used should be understood in a broad sense. For example, the "connection" can be a fixed connection, a detachable connection, or an integrated setting; it can be a mechanical connection, an electrical connection, or a communication connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium; it can be the internal connection of two elements or the interaction relationship between two elements. For technicians in the technical field to which the present application belongs, the specific meanings of the above terms in the embodiments of the present application can be understood according to the specific circumstances.

[0020] See also Figures 1 to 3 , this embodiment provides a dance teaching method. The dance teaching method can be applied to online dance teaching, that is, dance teachers and dance students can conduct dance teaching in different locations and through the Internet. Through this dance teaching method, a dance teacher can teach multiple dance students at the same time; and it can solve the technical problem in the related art that it is difficult for dance students to master the limb movement speed (i.e., the strength of dance movements) when switching between different movements in the dance. In this dance teaching method, the acceleration difference of the limb parts in the practice data of the dance student can be analyzed to obtain the dance movement strength of each limb part when completing each dance movement, and generate the correct virtual dance movement of each limb part, and superimpose the virtual dance movement with the corresponding dance movement in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

[0021] like Figure 1 As shown, in this embodiment, the dance teaching method includes the following steps: S101, receiving a dance teaching video sent by a dance teacher terminal, wherein the teaching video includes a reference ruler of standard length; establishing a three-dimensional coordinate system according to the reference ruler and calculating the height parameter of the dance teacher in the teaching video; preferably, the teaching video is a stereoscopic video shot by a dual camera. Select the joints of the dance teacher's body in the teaching video, and identify two or more adjacent joints as associated joints of the same limb according to the limbs of the human body. In step S101, the reference ruler can be a tape measure or other measuring tool that can measure length or height. Setting the reference ruler can accurately calculate the height parameter of the dance teacher through image analysis, thereby providing accurate basic data for the transformation ratio of the exercise data in the following steps. The joints selected on the dance teacher's body include: neck joints, shoulder joints, wrist joints, elbow joints, hip joints, knee joints and ankle joints, and finger joints. Among them, the elbow joints include the left elbow joints and the right elbow joints, and the knee joints and ankle joints also include the knee joints and ankle joints of the left leg and the knee joints and ankle joints of the right leg. A joint point is set at both ends of each of the above joints, for example, a joint point is set at the proximal end and the distal end of the wrist joint. The associated joint points are set according to the limbs of the human body. For example, taking the hand as an example, the corresponding associated joints are the shoulder joint, wrist joint, elbow joint and finger joint; in some embodiments, the associated joints of the hand can also be the wrist joint and the elbow joint.

[0022] S102, the teaching video is subjected to frame splitting and adjacent frame comparison processing, and a plurality of key frames whose coordinate offset of the joint point is greater than a preset value are obtained; the timestamp of the key frame and the coordinate value of each joint point are recorded; the time interval between two adjacent key frames is obtained according to the timestamp, and the acceleration value of the limb part in different key frames is calculated in combination with the change of the coordinate value of the associated joint point, and marked as the first acceleration value; the first acceleration value of the limb part, the timestamp of the key frame, and the coordinate value of the joint point are integrated to generate a dance teaching file. In step S102, the teaching video is firstly subjected to frame splitting processing to obtain a series of continuous frames, and then adjacent frames are compared to determine whether the features therein have obvious changes. If so, the coordinate offset of each joint point is calculated. When the coordinate offset of one or more joint points is greater than a preset value (e.g., 20 cm), the frame is considered to be a key frame, and the interval frames between the key frames are deleted. After obtaining the key frame, the associated joint points in the key frame are obtained and compared with the associated joint points of the same limb part in the previous key frame to obtain the coordinate offset of each joint point in the associated joint points, and based on the coordinate offset and the time interval between the two key frames (i.e., subtracting the timestamps corresponding to the two key frames), the first acceleration value of the limb part is calculated.

[0023] S103, receiving dance practice data uploaded by the dance student terminal, and performing data conversion based on the height parameter, specifically including: the practice data includes the height parameter of the dance student, as well as the position information of each joint and the second acceleration value of each limb part of the dance student during the dance practice, the position information of each joint and the second acceleration value are obtained by wearing position sensors on each joint of the dance student and performing dance practice; preferably, the position sensor is a six-axis gyroscope, and the position sensor is arranged on the dance costume. Wherein, in addition to collecting the position information of each joint and the second acceleration value of each limb part during the dance practice, the video data of the dance practice is also collected, but the uploaded practice data does not include the video data, so that the amount of uploaded data can be reduced. The second acceleration value of each limb part can be directly collected by the six-axis gyroscope.

[0024] S104, matching the practice data with the key frames, that is, matching the dance movements in the practice data with the key frames of the same dance movements in the dance teaching file, so that the dance movements in the practice data correspond to the key frames one by one, specifically including: based on the height parameters of the dance teacher and the height parameters of the dance student, obtaining a transformation ratio, multiplying the position information of each joint of the dance student and the second acceleration value by the transformation ratio respectively, to obtain corresponding third position information and third acceleration value; calculating the dance movements at different times in the practice data based on the third position information of each joint, and matching the dance movements with the coordinate values ​​of each joint point in the dance teaching file, so as to obtain the key frames corresponding to the dance movements at different times in the practice data in the dance teaching file. In step S104, calculating the transformation ratio and using the transformation ratio to transform the practice data is to more accurately match the practice data and the key frames, and to obtain a more accurate positive value of the dance movement speed modification in step S105. For example, the height of the dance teacher is 1.7 meters, and the height of the dance student is 1.1 meters. In the dance teaching file, the first acceleration value of the hand in a certain dance action is 0.02g (this value is too large for the above-mentioned dance student). At this time, the first acceleration value can be proportionally reduced according to the transformation ratio (1.1 / 1.7) to obtain an acceleration value suitable for the student. When matching the practice data with the key frame in step S104, the dance action can be marked and saved for each key frame, and then the third position information of each joint is calculated and analyzed to obtain the posture of each limb part, and then the posture of each limb part is combined to obtain a complete dance action, and finally matched with the key frame. In this step, the dance action in the practice data can be accurately matched with the key frame of the same dance action one by one, and there is no need to use artificial intelligence image analysis technology, which can greatly reduce the amount of image processing data and reduce the requirements for software and hardware.

[0025] S105. Generating correct virtual dance movements for each body part presented by a virtual object based on virtual reality technology, specifically comprising: calculating each acceleration difference between the third acceleration value of each dance movement and the first acceleration value of each corresponding key frame; obtaining a dance movement speed modification positive value for each body part based on the acceleration difference; combining the practice data and the dance movement speed modification positive value, and generating correct virtual dance movements for each body part presented by a virtual object based on virtual reality technology.

[0026] S106, returning the virtual dance movements to the dance student terminal, and superimposing the virtual dance movements with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

[0027] In actual application, dance teachers can upload one or more teaching videos at a time, and the corresponding dance teaching files generated are stored in the cloud server.

[0028] When practicing dance, the dance student first wears each position sensor, collects the position information of each joint and the second acceleration value of each limb part through the position sensor, and shoots the video data of the dance practice through the camera. Then, the position information of each joint and the second acceleration value of each limb part are uploaded to the server, and the cloud server compares and analyzes the practice data and the corresponding dance teaching file, and then generates the correct virtual dance movements of each limb part in step S105, and finally returns the simulated dance movement to the dance student terminal, and the dance student terminal superimposes the virtual dance movement with the corresponding dance movement in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in layers in the dance practice video. Thereby, the dance student can intuitively see the dance movement of each limb part and the correct virtual dance movement corresponding to each limb part, so that the dance student can quickly master the limb movement speed when switching between different movements in the dance, and improve the quality and efficiency of online dance teaching.

[0029] like Figure 2 As shown, in the above embodiment, the combination of the practice data and the dance movement speed modification positive value, and the generation of correct virtual dance movements of each limb part presented by a virtual object based on virtual reality technology, include: S201, creating a virtual object using virtual reality modeling software according to the joint position information in the exercise data; S202, binding the joint position information to the virtual object, so that when the joint position information changes, the virtual object moves accordingly; S203, correcting the second acceleration value of the corresponding limb part in the training data according to the dance movement speed modification positive value, and making the limb part in the virtual object perform the dance movement of the corresponding part according to the corrected second acceleration value, so as to obtain a dynamic image of the correct virtual dance movement of each limb part of the virtual object.

[0030] The virtual reality modeling software may be any one of Unity, Unreal Engine, etc.

[0031] Before binding the joint position information with the virtual object, the joint position information and other data need to be preprocessed by format conversion, coordinate adjustment, etc. to ensure that the data can be correctly parsed and used by the virtual reality system.

[0032] When creating a virtual object, you can define the position and orientation of each joint point in the virtual environment, and use virtual reality modeling software to first create a skeleton model of the virtual object based on the joint point coordinates; then add skin, texture, material, etc. to the virtual object to make its appearance more realistic.

[0033] like Figure 3 As shown, in the above embodiment, the virtual dance movements are superimposed with the corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a superimposed manner in the dance practice video, including: S301, when returning the virtual dance movements to the dance student terminal, the timestamp and body part number corresponding to each virtual dance movement are also returned; S302, importing the virtual dance movements and corresponding timestamps and body part numbers into video editing software, and using the video editing software to open the dance practice video; S303, superimposing the virtual dance movement on the upper layer of the corresponding moment and the corresponding body part in the dance practice video according to the timestamp and the body part number through the video editing software, and transparently processing the virtual dance movement so that the dynamic image of the virtual dance movement and the dance practice video are visible and played synchronously.

[0034] The video editing software may be dobe Premiere Pro, Final Cut Pro, Unity, UnrealEngine, etc. The dance student terminal may call the video editing software through the API interface provided by the video editing software. In the video editing software, the virtual object is placed above the video layer so that it covers the dancer, and the transparency, size, position and other parameters of the virtual object are adjusted to ensure that it is displayed in a desired manner in superposition with the dance video.

[0035] like Figure 4 As shown, in another embodiment, a dance teaching system 400 is provided. The dance teaching system 400 includes: a dance teacher terminal 401, a dance student terminal 402 and a service terminal 403. The dance teacher terminal 401 is used to send a dance teaching video, wherein the teaching video includes a reference ruler of standard length; a three-dimensional coordinate system is established according to the reference ruler, and a height parameter of the dance teacher in the teaching video is calculated.

[0036] The dance student terminal 402 is used to upload dance practice data, which includes the height parameters of the dance student, as well as the position information of each joint and the second acceleration value of each limb part of the dance student during the dance practice. The position information of each joint and the second acceleration value are obtained by wearing position sensors on each joint of the dance student and performing dance practice.

[0037] The service terminal 403 is used to select the joints of the dance teacher's body in the teaching video, and identify two or more adjacent joints as associated joints of the same limb according to the limb parts of the human body; split the teaching video into frames and compare adjacent frames to obtain multiple key frames in which the coordinate offset of the joints is greater than a preset value; record the timestamp of the key frame and the coordinate value of each joint; obtain the time interval between two adjacent key frames according to the timestamp, and calculate the acceleration value of the limb in different key frames in combination with the change in the coordinate value of the associated joint, and mark it as the first acceleration value; integrate the first acceleration value of the limb, the timestamp of the key frame, and the coordinate value of the joint to generate a dance teaching file.

[0038] Based on the height parameters of the dance teacher and the dance student, a transformation ratio is obtained, and the position information of each joint of the dance student and the second acceleration value are multiplied by the transformation ratio respectively to obtain corresponding third position information and third acceleration value.

[0039] The dance movements at different moments in the practice data are calculated based on the third position information of each joint, and the dance movements are matched with the coordinate values ​​of each joint point in the dance teaching file to obtain the key frames in the dance teaching file corresponding to the dance movements at different moments in the practice data.

[0040] Calculate the acceleration differences between the third acceleration value of each dance movement and the first acceleration value of each corresponding key frame; obtain the dance movement speed modification positive value of each limb part based on the acceleration difference; combine the practice data and the dance movement speed modification positive value, and generate correct virtual dance movements for each limb part presented as virtual objects based on virtual reality technology; and return the virtual dance movements to the dance student terminal.

[0041] The dance student terminal 402 is also used to superimpose the virtual dance movements with the corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

[0042] In the above embodiment, the combination of the practice data and the dance movement speed modification positive value, and the generation of correct virtual dance movements of various limbs presented by virtual objects based on virtual reality technology, includes: A virtual object is created using virtual reality modeling software based on the joint position information in the exercise data.

[0043] The joint position information is bound to the virtual object so that when the joint position information changes, the virtual object moves accordingly.

[0044] The second acceleration value of the corresponding limb part in the training data is corrected according to the dance movement speed modification positive value, and the limb part in the virtual object is made to perform the corresponding dance movement according to the corrected second acceleration value, so as to obtain a dynamic image of the correct virtual dance movement of each limb part of the virtual object.

[0045] In the above embodiment, the virtual dance movements are superimposed with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a superimposed manner in the dance practice video, including: When the virtual dance movements are returned to the dance student terminal, the timestamp and body part number corresponding to each virtual dance movement are also returned.

[0046] The virtual dance movements and corresponding timestamps and body part numbers are imported into video editing software, and the dance practice video is opened using the video editing software.

[0047] The video editing software is used to superimpose the virtual dance movements on the upper layer of the corresponding moment and the corresponding body part in the dance practice video according to the timestamp and the body part number, and the virtual dance movements are transparently processed so that the dynamic image of the virtual dance movements and the dance practice video are visible and played synchronously.

[0048] The above embodiment can calculate the acceleration value of the limbs during the dance action from the change of the coordinate value of the associated joint point in the dance teaching video, and generate a dance teaching file including the first acceleration value, the timestamp of the key frame, and the coordinate value of the joint point; and based on the third position information of each joint, the key frame corresponding to the dance action at different times in the practice data can be calculated to achieve the action matching of each dance action in the teaching video with the practice data; and the transformation ratio is obtained according to the height parameter difference between the teacher and the student, so as to overcome the influence of the height difference, and accurately obtain the acceleration difference between each limb and the normal dance action, which represents the difference in the speed of limb movement when different dance actions are switched; and based on virtual reality technology, the correct virtual dance action of each limb presented by a virtual object is generated, so that each dance action and the corresponding virtual dance action are displayed in a layered manner in the dance practice video. Thereby, dance students can intuitively see the dance actions of each limb and the correct virtual dance actions corresponding to each limb, so that dance students can quickly master the speed of limb movement when different actions are switched in the dance, and improve the quality and efficiency of online dance teaching.

[0049] Finally, it should be noted that although the above embodiments have been described in the specification and drawings of this application, this does not limit the scope of patent protection of this application. All technical solutions generated by replacing or modifying equivalent structures or equivalent processes based on the essential concept of this application using the contents recorded in the specification and drawings of this application, as well as directly or indirectly implementing the technical solutions of the above embodiments in other related technical fields, are included in the scope of patent protection of this application.

Claims

1. A dance teaching method, characterized in that: The following steps are involved: Receive a dance teaching video sent by a dance teacher terminal, wherein the teaching video includes a reference ruler of standard length; establish a three-dimensional coordinate system according to the reference ruler and calculate the height parameter of the dance teacher in the teaching video; select various joints of the dance teacher's body in the teaching video, and identify two or more adjacent joints as associated joints of the same limb part according to the limb parts of the human body; The teaching video is subjected to frame splitting and adjacent frame comparison processing to obtain a plurality of key frames in which the coordinate offset of the joint point is greater than a preset value; the timestamps of the key frames and the coordinate values ​​of each of the joint points are recorded; The time interval between two adjacent key frames is obtained according to the timestamp, and the acceleration value of the limb part in different key frames is calculated in combination with the change of the coordinate value of the associated joint point, and marked as the first acceleration value; the first acceleration value of the limb part, the timestamp of the key frame, and the coordinate value of the joint point are integrated to generate a dance teaching file; Receive dance practice data uploaded by a dance student terminal, the practice data including a height parameter of the dance student, and position information of each joint and a second acceleration value of each limb part of the dance student during the dance practice, the position information of each joint and the second acceleration value are collected by wearing a position sensor on each joint of the dance student and performing dance practice; Based on the height parameter of the dance teacher and the height parameter of the dance student, a transformation ratio is obtained, and the position information of each joint of the dance student and the second acceleration value are respectively multiplied by the transformation ratio to obtain corresponding third position information and third acceleration value; Calculating dance movements at different moments in the practice data based on the third position information of each joint, and matching the dance movements with the coordinate values ​​of each joint point in the dance teaching file to obtain the key frames in the dance teaching file corresponding to the dance movements at different moments in the practice data; Calculating each acceleration difference between the third acceleration value of each dance action and the first acceleration value of each corresponding key frame; obtaining a dance action speed modification positive value of each limb part based on the acceleration difference; combining the practice data and the dance action speed modification positive value, and generating a correct virtual dance action of each limb part presented by a virtual object based on virtual reality technology; The virtual dance movements are returned to the terminal of the dance student, and the virtual dance movements are superimposed with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

2. The dance teaching method according to claim 1, characterized in that: The method of combining the practice data and the dance movement speed modification positive value and generating correct virtual dance movements of various limbs presented by virtual objects based on virtual reality technology includes: Creating a virtual object using virtual reality modeling software based on the joint position information in the exercise data; Binding joint position information to a virtual object so that when the joint position information changes, the virtual object moves accordingly; The second acceleration value of the corresponding limb part in the training data is corrected according to the dance movement speed modification positive value, and the limb part in the virtual object is made to perform the corresponding dance movement according to the corrected second acceleration value, so as to obtain a dynamic image of the correct virtual dance movement of each limb part of the virtual object.

3. The dance teaching method according to claim 2, characterized in that: The step of superimposing the virtual dance movements with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video, comprises: When returning the virtual dance movements to the dance student terminal, the timestamp and body part number corresponding to each virtual dance movement are also returned; Importing the virtual dance movements and corresponding timestamps and body part numbers into video editing software, and opening the dance practice video using the video editing software; The video editing software is used to superimpose the virtual dance movements on the upper layer of the corresponding moment and the corresponding body part in the dance practice video according to the timestamp and the body part number, and the virtual dance movements are transparently processed so that the dynamic image of the virtual dance movements and the dance practice video are visible and played synchronously.

4. The dance teaching method according to claim 1, characterized in that: The teaching video is a stereoscopic video shot by dual cameras.

5. The dance teaching method according to claim 1, characterized in that: The position sensor is a six-axis gyroscope, and the position sensor is arranged on the dance costume.

6. A dance teaching system, characterized in that: include: A dance teacher terminal is used to send a dance teaching video, wherein the teaching video includes a reference ruler of standard length; establish a three-dimensional coordinate system according to the reference ruler and calculate the height parameter of the dance teacher in the teaching video; A dance student terminal, used for uploading dance practice data, wherein the practice data includes a height parameter of the dance student, and position information of each joint and a second acceleration value of each limb part of the dance student during dance practice, wherein the position information of each joint and the second acceleration value are collected by wearing position sensors on each joint of the dance student and performing dance practice; The service terminal is used to select the joints of the dance teacher's body in the teaching video, and mark two or more adjacent joints as associated joints of the same limb according to the limbs of the human body; The teaching video is subjected to frame splitting and adjacent frame comparison processing to obtain a plurality of key frames in which the coordinate offset of the joint point is greater than a preset value; the timestamps of the key frames and the coordinate values ​​of each of the joint points are recorded; The time interval between two adjacent key frames is obtained according to the timestamp, and the acceleration value of the limb part in different key frames is calculated in combination with the change of the coordinate value of the associated joint point, and marked as the first acceleration value; the first acceleration value of the limb part, the timestamp of the key frame, and the coordinate value of the joint point are integrated to generate a dance teaching file; Based on the height parameter of the dance teacher and the height parameter of the dance student, a transformation ratio is obtained, and the position information of each joint of the dance student and the second acceleration value are respectively multiplied by the transformation ratio to obtain corresponding third position information and third acceleration value; Calculating dance movements at different moments in the practice data based on the third position information of each joint, and matching the dance movements with the coordinate values ​​of each joint point in the dance teaching file to obtain the key frames in the dance teaching file corresponding to the dance movements at different moments in the practice data; Calculating each acceleration difference between the third acceleration value of each dance action and the first acceleration value of each corresponding key frame; obtaining a dance action speed modification positive value of each limb part based on the acceleration difference; combining the practice data and the dance action speed modification positive value, and generating a correct virtual dance action of each limb part presented by a virtual object based on virtual reality technology; and returning the virtual dance movements to the dance student terminal; The dance student terminal is also used to superimpose the virtual dance movements with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video.

7. The dance teaching system according to claim 6, characterized in that: The method of combining the practice data and the dance movement speed modification positive value and generating correct virtual dance movements of various limbs presented by virtual objects based on virtual reality technology includes: Creating a virtual object using virtual reality modeling software based on the joint position information in the exercise data; Binding joint position information to a virtual object so that when the joint position information changes, the virtual object moves accordingly; The second acceleration value of the corresponding limb part in the training data is corrected according to the dance movement speed modification positive value, and the limb part in the virtual object is made to perform the corresponding dance movement according to the corrected second acceleration value, so as to obtain a dynamic image of the correct virtual dance movement of each limb part of the virtual object.

8. The dance teaching system according to claim 7, characterized in that: The step of superimposing the virtual dance movements with corresponding dance movements in the dance practice video of the dance student, so that each dance movement and the corresponding virtual dance movement are displayed in a stacked manner in the dance practice video, comprises: When returning the virtual dance movements to the dance student terminal, the timestamp and body part number corresponding to each virtual dance movement are also returned; Importing the virtual dance movements and corresponding timestamps and body part numbers into video editing software, and opening the dance practice video using the video editing software; The video editing software is used to superimpose the virtual dance movements on the upper layer of the corresponding moment and the corresponding body part in the dance practice video according to the timestamp and the body part number, and the virtual dance movements are transparently processed so that the dynamic image of the virtual dance movements and the dance practice video are visible and played synchronously.

Images