Dance training system based on virtual reality

Abstract

The invention relates to the technical field of virtual reality, and particularly discloses a virtual reality-based dance training system, which comprises VR glasses used for providing VR scene display; the somatosensory peripheral is used for capturing action information of a user; the network synchronization module comprises a receiving module and a network module, the network module is connected with the cloud server and shares the data of the dance courses in the cloud server, and the receiving module automatically downloads update packages of the dance courses; according to the invention, through the character selection module and the virtual environment selection module, students can select training teachers and virtual scenes according to own preferences, so that the interestingness and individuation of training are increased. According to the invention, through cooperative work of the identification module, the correction module and the scoring module, defects of actions of students can be found in time, targeted guidance and scoring are provided, and the dance level of the students can be rapidly improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and specifically refers to a dance training system based on virtual reality. Background Art

[0002] Traditional dance training mainly relies on on-site guidance by coaches and repeated practice by trainees. This method has certain limitations. For example, coaches have limited energy and it is difficult to provide meticulous guidance on the movements of each trainee; trainees also have difficulty intuitively understanding the deficiencies in their movements during practice; moreover, the training scenarios are relatively single, which easily makes trainees feel bored. With the development of virtual reality technology, its application in the field of dance training has become a new trend, but the existing related systems still need to be improved in terms of functional integrity and user experience.

[0003] Therefore, a dance training system based on virtual reality has become an urgent problem to be solved by people. Summary of the Invention

[0004] The purpose of the present invention is to provide a dance training system based on virtual reality, which combines virtual reality technology and multiple functional modules to provide trainees with a more rich, efficient, and personalized dance training experience and solve the problems existing in traditional dance training methods.

[0005] To solve the above technical problems, the technical solution provided by the present invention is: A dance training system based on virtual reality, comprising:

[0006] A VR glasses for providing VR scene display;

[0007] A somatosensory peripheral device for capturing the motion information of the user;

[0008] A network synchronization module, the network synchronization module includes a receiving module and a network module, the network module is connected to a cloud server to share the dance course data in the cloud server, and the receiving module automatically downloads the update package of the dance course;

[0009] A human-computer interaction module, the human-computer interaction module includes a character selection module, a virtual environment selection module, a practice module, an identification module, an intelligent AI dialogue module, a correction module, and a scoring module;

[0010] The character selection module provides different character selections. The somatosensory peripheral device collects three-dimensional stereo images and transmits the character information to the identification module. The identification module identifies the image signal and generates a three-dimensional stereo character image, and then transmits the three-dimensional stereo character information to the cloud server through the network module;

[0011] The virtual environment selection module provides different virtual scenarios for dance learning, and the background manager uploads different virtual scenarios to the cloud server;

[0012] The practice module provides a basic scenario for dance practice, urges students to correct non-standard actions during the dance process, and provides guidance;

[0013] The recognition module intelligently analyzes and recognizes the dance movement information captured by the somatosensory peripheral device, and compares and analyzes it with the standard movements;

[0014] The intelligent AI dialogue module provides a voice basis for students in the practice module and the scoring module, and outputs voice information;

[0015] The correction module corrects incorrect actions in the practice module until they meet the standards;

[0016] The scoring module scores each movement of the dance practice, then comprehensively scores, and uploads the scoring information to the cloud server through the network module.

[0017] Furthermore, the somatosensory peripheral device includes a rechargeable battery, a scanner, a signal transmitter, and a full-body motion capture sensing controller, which are used to capture the action information of the user.

[0018] Furthermore, the human-computer interaction module further includes a physical fitness detection module. The physical fitness detection module real-time detects the user's physical fitness, captures the facial information and action information of the student through the somatosensory peripheral device, and then transmits it to the recognition module. The recognition module comprehensively processes the received information to judge the user's physical fitness. For users who reach the set fatigue value, the intelligent AI dialogue module issues a voice prompt to suggest resting for a set time; after reaching the set time, if the user appears in the area of the somatosensory peripheral device and wears a VR headset, then continue learning.

[0019] Furthermore, the human-computer interaction module further includes a remote video module. The remote video module includes a remote video camera and a remote signal pairing module provided on the somatosensory peripheral device. The remote signal pairing module includes a signal transmitter and a signal receiver. A VR glasses terminal sends a video request to the signal receiver through the transmitter. The operator confirms the video request signal of the signal receiver on another VR glasses terminal, and the signal transmitter and the signal receiver are successfully paired. The remote video module connects two VR glasses through the remote signal pairing module, and transmits the image signals of the trainee or teacher to the virtual display interfaces of the VR glasses on both sides through the image sensor provided in the somatosensory peripheral device, establishing an online video connection. The full-body motion capture sensor captures the dance motion information of the trainee in real time and transmits it to the recognition module. After the recognition module identifies it, it marks the non-standard positions and uploads them to the cloud server through the network module, and then transmits the video to the VR glasses of the corresponding teacher in real time. The teacher combines the non-standard actions marked in the video for assessment.

[0020] Furthermore, the recognition module can intelligently analyze and recognize the dance motion information transmitted from the somatosensory peripheral device to the recognition module. The dance motion information of the trainee is captured through the somatosensory peripheral device and transmitted to the recognition module. The recognition module compares and analyzes the dance motion information of the trainee with the standard motions in the receiving module for recognition.

[0021] Furthermore, the intelligent AI dialogue module provides a voice basis for the trainee in the practice module and the scoring module. The dance motion information is recognized by the recognition module, and then a voice command is output to the intelligent AI dialogue module. The voice module outputs voice, and the trainee receives the voice information. The intelligent AI dialogue module receives the voice signal sent by the trainee, transmits the voice signal to the recognition module, compares it with the internal database for analysis and recognition, and outputs the corresponding voice signal or opens the corresponding function module after recognition and analysis.

[0022] Furthermore, the character selection module provides different character selections for the trainee. The teacher collects his own three-dimensional stereo image through the somatosensory peripheral device and transmits the character information to the recognition module. The recognition module recognizes the image signal and generates a three-dimensional stereo character image, and then transmits the three-dimensional stereo character information to the cloud server through the network module. By uploading the teacher's three-dimensional stereo image to the cloud server, it provides basic data for the trainee to select a teacher according to personal hobbies when learning dance.

[0023] Further, the correction module corrects the incorrect movements of the trainees in the practice module. The somatosensory peripheral device collects the dance movement information of the trainees and uploads the movement information to the recognition module. According to the movement information transmitted from the somatosensory peripheral device to the recognition module, it is compared with the dance course database stored inside the recognition module, and the comparison information is transmitted to the VR virtual display device and the intelligent AI dialogue module. When a certain movement of the trainee does not meet the standard, the dance course is paused, and the position where the movement is not standard is marked in the virtual scene, and voice guidance is provided to prompt the trainee to repeat the previous movement. After the trainee repeats the above movement to meet the standard, the dance course continues.

[0024] Further, the practice module provides a basic scenario for the trainees to practice dancing and urges the trainees to correct the non-standard movements during the dance process. The somatosensory peripheral device captures and collects the dance movement information of the trainees and transmits it to the recognition module. The recognition module compares the dance movement information of the trainees with the data in the internal dance course package, and transmits the comparison information to the VR virtual display and the intelligent AI dialogue module to provide voice guidance for the trainees so that the trainees can practice targeted.

[0025] Further, the scoring module scores each movement of the trainees' dance practice and then comprehensively scores. The somatosensory peripheral device captures and collects the dance movement information of the trainees and transmits it to the recognition module. The recognition module compares and scores the dance movement information of the trainees with the data in the internal dance course package, and uploads the scoring information to the cloud server through the network module. The background can download this data in the cloud server, and a special teacher can conduct offline interviews and tutoring according to the trainees' scores and difficulties.

[0026] The advantages of the present invention compared with the prior art are as follows: through the character selection module and the virtual environment selection module, trainees can select training teachers and virtual scenes according to their own preferences, increasing the fun and personalization of training.

[0027] Through the collaborative work of the recognition module, the correction module and the scoring module, the present invention can timely discover the deficiencies of the trainees' movements and provide targeted guidance and scoring, which helps the trainees quickly improve their dance level.

[0028] Through the physical fitness detection module, the present invention can real-time monitor the physical fitness status of the trainees, avoid overtraining, and ensure the physical health of the trainees.

[0029] Through the remote video module, the present invention realizes the online video connection between the trainees and the teachers, facilitating the teachers to conduct remote guidance and assessment, breaking through the geographical restrictions.

[0030] Through the receiving module of the network synchronization module of the present invention, the update package of the dance course can be automatically downloaded to ensure that the trainees can access the latest dance course content. Description of the Drawings

[0031] Figure 1 is the system block diagram of a virtual reality-based dance training system of the present invention.

[0032] Figure 2 is the system block diagram of the human-computer interaction module. Detailed Embodiments

[0033] In the description of the present invention, it should be understood that the orientation or positional relationships indicated by the terms "upper", "lower", "front", "rear", "left", "right", "inner", "outer", "vertical", "circumferential", etc. are based on the orientation or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention.

[0034] In the present invention, unless otherwise clearly defined and limited, the terms "installation", "connection", "connection", "fixation", etc. should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

[0035] The following further describes in detail a virtual reality-based dance training system of the present invention with reference to the drawings.

[0036] Combined with the attached Figure 1-2 , the present invention is introduced in detail.

[0037] A virtual reality-based dance training system includes the following components:

[0038] VR glasses: used to provide VR scene display, enabling trainees to experience the dance training environment immersive.

[0039] The somatosensory peripheral device: includes a rechargeable battery, a scanner, a signal transmitter, and a full-body motion capture sensing controller, which is used to capture the action information of the user. Its working principle is to use the full-body motion capture sensing controller to monitor the user's actions in real time, convert the action information into electrical signals, and transmit them to other modules of the system through the signal transmitter.

[0040] The network synchronization module includes:

[0041] Receiving Module: Automatically download the update package of dance courses to ensure that students can obtain the latest dance course content in a timely manner.

[0042] Network Module: Connect to the cloud server to share the dance course data in the cloud server. Through the network module, the system can upload and download data, ensuring that students can access rich dance course resources.

[0043] The human-computer interaction module includes:

[0044] Character Selection Module: Provide different character selections for students. The teacher can collect their own three-dimensional stereo images through a somatosensory peripheral device and transmit the character information to the recognition module. The recognition module recognizes the image signal and generates a three-dimensional stereo character image, and then transmits the three-dimensional stereo character information to the cloud server through the network module. In this way, students can choose a teacher according to their personal hobbies when learning dance, adding personalized elements to the learning process.

[0045] Virtual Environment Selection Module: Provide different virtual scenarios for dance learning. The background administrator can upload different virtual scenarios to the cloud server, and students can choose a suitable training scenario according to their preferences, increasing the fun and immersion of training.

[0046] Practice Module: Provide a basic scenario for dance practice and urge students to correct non-standard actions during the dance process. The specific process is as follows: Capture and collect the dance movement information of students through a somatosensory peripheral device and transmit it to the recognition module. The recognition module compares the dance movement information of students with the data in the internal dance course package and transmits the comparison information to the VR virtual display and intelligent AI dialogue module to provide voice guidance for students, enabling them to practice targeted.

[0047] Recognition Module: Intellectually analyze and recognize the dance movement information transmitted from the somatosensory peripheral device to the recognition module. Capture the dance movement information of students through a somatosensory peripheral device and transmit the captured dance movement information to the recognition module. The recognition module compares and analyzes the dance movement information of students with the standard actions in the receiving module for recognition. The recognition module can also comprehensively process the facial information and movement information of students collected by the somatosensory peripheral device to judge the user's physical fitness.

[0048] Intelligent AI Dialogue Module: Provide a voice basis for students in the practice module and scoring module. Recognize the dance movement information through the recognition module, and then output voice instructions to the intelligent AI dialogue module. The voice module outputs voice, and students receive the voice information. At the same time, the intelligent AI dialogue module receives the voice signals sent by students and transmits the voice signals to the recognition module for comparison and analysis with the internal database. After recognition and analysis, it outputs corresponding voice signals or opens corresponding function modules.

[0049] Correction Module: Corrects the wrong movements of trainees in the practice module. The somatosensory peripheral device collects the dance movement information of trainees and uploads the movement information to the recognition module. According to the movement information transmitted from the somatosensory peripheral device to the recognition module, it is compared with the dance course database stored inside the recognition module, and the comparison information is transmitted to the VR virtual display device and the intelligent AI dialogue module. When a trainee's certain movement does not meet the standard, the dance course is paused, and the position where the movement is not standard is marked in the virtual scene, and voice guidance is given to prompt the trainee to repeat the previous movement. After the trainee repeats the above movement to meet the standard, the dance course continues.

[0050] Scoring Module: Scores each movement of the trainee's dance practice and then comprehensively scores. The somatosensory peripheral device captures and collects the dance movement information of the trainee and transmits it to the recognition module. The recognition module compares and scores the trainee's dance movement information with the internal dance course package data, and uploads the scoring information to the cloud server through the network module. The background can download this data in the cloud server, and a dedicated teacher conducts offline interviews and tutoring based on the trainee's score and difficulties.

[0051] Physical Fitness Detection Module: Real-time detects the user's physical fitness. The somatosensory peripheral device captures the facial information and movement information of the trainee, and then transmits it to the recognition module. The recognition module comprehensively processes the received information to judge the user's physical fitness. For users who reach the set fatigue value, the intelligent AI dialogue module issues a voice prompt to suggest resting for the set time; after the set time, when the user appears in the area of the somatosensory peripheral device and wears the VR glasses, then continue to learn.

[0052] Remote Video Module: Includes a remote video camera and a remote signal pairing module installed on the somatosensory peripheral device. The remote signal pairing module includes a signal transmitter and a signal receiver. A VR glasses terminal sends a video request to the signal receiver through the transmitter, and the operator confirms the video request signal of the signal receiver on another VR glasses terminal, and the signal transmitter and the signal receiver are successfully paired. The remote video module connects two VR glasses through the remote signal pairing module, and transmits the image signal of the trainee or teacher to the virtual display interfaces of both VR glasses through the image sensor installed inside the somatosensory peripheral device to establish an online video connection. The full-body motion capture sensor captures the dance movement information of the trainee in real time and transmits it to the recognition module. The recognition module marks the non-standard positions after recognition and uploads them to the cloud server through the network module, and then transmits the video to the VR glasses of the corresponding teacher in real time. The teacher combines the non-standard movements marked in the video for assessment.

[0053] The specific implementation process of a virtual reality-based dance training system of the present invention is as follows:

[0054] System Initialization:

[0055] When a trainee uses the system for the first time, some initialization settings are required. Turn on the VR glasses and the somatosensory peripheral device. The system connects to the cloud server through the network module and downloads the latest dance course data and virtual scene resources. The trainee can select the three-dimensional character image of their favorite teacher in the character selection module and at the same time select a suitable training scene in the virtual environment selection module.

[0056] Dance training process:

[0057] After the trainee enters the practice module, they start dancing. The somatosensory peripheral device captures the trainee's dance movement information in real time and transmits it to the recognition module. The recognition module compares the trainee's movement information with the data in the internal dance course package to determine whether the movement is standard. If the movement is not standard, the recognition module transmits the comparison information to the VR virtual display and intelligent AI dialogue module. The virtual display interface of the VR glasses will mark the non-standard position of the movement, and the intelligent AI dialogue module will output voice guidance to prompt the trainee how to correct the movement. The trainee repeats the practice according to the prompt until the movement reaches the standard and then continues with the subsequent dance practice.

[0058] During the training process, the physical fitness detection module captures the trainee's facial information and movement information through the somatosensory peripheral device, transmits it to the recognition module for comprehensive processing, and judges the trainee's physical fitness. When the trainee's physical fitness reaches the set fatigue value, the intelligent AI dialogue module will issue a voice prompt, suggesting that the trainee rest for a set time. After the rest time, if the trainee appears within the area of the somatosensory peripheral device and wears the VR glasses, the system will automatically resume training.

[0059] After the dance practice, the scoring module scores each movement of the trainee and comprehensively obtains the final score. The scoring information is uploaded to the cloud server through the network module. The backstage teacher can download this data and arrange offline interviews and tutoring according to the trainee's score and difficult points.

[0060] Remote teaching:

[0061] If a trainee needs remote guidance from a teacher, they can initiate a video request through the remote video module. The VR glasses terminal of the trainee sends a video request from the signal transmitter of the remote signal pairing module to the signal receiver of the teacher's VR glasses terminal. After the teacher confirms the request at the terminal, an online video connection is established between the two parties. The image sensor in the somatosensory peripheral device transmits the trainee's image signal into the virtual display interface of the teacher's VR glasses. At the same time, the full-body motion capture sensor captures and transmits the trainee's dance movement information to the recognition module. After the recognition module identifies it, it marks the non-standard position and uploads it to the cloud server through the network module, and then transmits the video in real time into the teacher's VR glasses. The teacher can conduct assessment and guidance on the trainee by combining the non-standard movements marked in the video.

[0062] The present invention and its embodiments have been described above. Such description is not restrictive. What is shown in the drawings is only one of the embodiments of the present invention, and the actual structure is not limited thereto. In general, if those of ordinary skill in the art are inspired by it and, without departing from the gist of the present invention, creatively design structural modes and embodiments similar to the technical solution, they shall fall within the protection scope of the present invention.

Claims

1. A virtual reality-based dance training system, characterized in that: including a VR glasses for providing VR scene display; a somatosensory peripheral device for capturing the action information of the user; a network synchronization module, the network synchronization module includes a receiving module and a network module, the network module is connected to a cloud server to share the dance course data in the cloud server, and the receiving module automatically downloads the update package of the dance course; a human-computer interaction module, the human-computer interaction module includes a character selection module, a virtual environment selection module, a practice module, an identification module, an intelligent AI dialogue module, a correction module and a scoring module; the character selection module provides different character selections, the somatosensory peripheral device collects three-dimensional stereo images, and transmits the character information to the identification module, the identification module identifies the image signal and generates a three-dimensional stereo character image, and then transmits the three-dimensional stereo character information to the cloud server through the network module; the virtual environment selection module provides different virtual scenes for dance learning, and the background manager uploads different virtual scenes to the cloud server; the practice module provides a basic scene for dance practice, urges the students to correct the non-standard actions during the dance process, and provides guidance; the identification module intelligently analyzes and identifies the dance action information captured by the somatosensory peripheral device, and compares and analyzes it with the standard actions; the intelligent AI dialogue module provides a voice basis for the students in the practice module and the scoring module, and outputs voice information; the correction module corrects the wrong actions in the practice module until they reach the standard; the scoring module scores each action of the dance practice, then comprehensively scores, and uploads the scoring information to the cloud server through the network module.

2. The virtual reality-based dance training system according to claim 1, wherein: the somatosensory peripheral device includes a rechargeable battery, a scanner, a signal transmitter and a whole-body motion capture sensor controller for capturing the action information of the user.

3. The virtual reality-based dance training system according to claim 2, characterized in that: the human-computer interaction module further includes a physical fitness detection module, the physical fitness detection module real-time detects the physical fitness of the user, captures the facial information and action information of the students through the somatosensory peripheral device, and then transmits them to the identification module, the identification module comprehensively processes the received information, judges the physical fitness of the user, and for the user who reaches the set fatigue value, the intelligent AI dialogue module issues a voice prompt to suggest resting for the set time; after reaching the set time, when the user appears in the area of the somatosensory peripheral device and wears the VR glasses, then continue to learn.

4. The virtual reality-based dance training system according to claim 3, wherein: The human-computer interaction module further includes a remote video module. The remote video module includes a remote video camera and a remote signal pairing module provided on the somatosensory peripheral device. The remote signal pairing module includes a signal transmitter and a signal receiver. A VR glasses terminal sends a video request to the signal receiver through the transmitter, and the operator confirms the video request signal of the signal receiver on another VR glasses terminal, and the signal transmitter and the signal receiver are successfully paired. The remote video module connects two VR glasses through the remote signal pairing module, and transmits the image signals of the trainee or teacher to the virtual display interfaces of the VR glasses on both sides through the image sensor provided in the somatosensory peripheral device, establishing an online video connection. The full-body motion capture sensor captures the dance motion information of the trainee in real time and transmits it to the recognition module. The recognition module marks the non-standard positions after recognition and uploads them to the cloud server through the network module, and then transmits the video to the VR glasses of the corresponding teacher in real time. The teacher conducts assessment based on the non-standard actions marked in the video.

5. The virtual reality-based dance training system according to claim 4, wherein: The recognition module can intelligently analyze and recognize the dance motion information transmitted from the somatosensory peripheral device to the recognition module; The somatosensory peripheral device captures the dance motion information of the trainee and transmits the captured dance motion information to the recognition module. The recognition module compares and analyzes the dance motion information of the trainee with the standard motions in the receiving module for recognition.

6. The virtual reality-based dance training system according to claim 5, wherein: The intelligent AI dialogue module provides a voice basis for the trainee in the practice module and the scoring module. The dance motion information is recognized by the recognition module, and then a voice command is output to the intelligent AI dialogue module. The voice module outputs voice, and the trainee receives the voice information. The intelligent AI dialogue module receives the voice signal sent by the trainee and transmits the voice signal to the recognition module for comparison and analysis with the internal database. After recognition and analysis, the corresponding voice signal is output or the corresponding function module is opened.

7. The virtual reality-based dance training system according to claim 6, wherein: The character selection module provides different character selections for the trainee. The teacher collects his own three-dimensional stereo image through the somatosensory peripheral device and transmits the character information to the recognition module. The recognition module recognizes the image signal and generates a three-dimensional stereo character image, and then transmits the three-dimensional stereo character information to the cloud server through the network module. By uploading the three-dimensional stereo image of the teacher to the cloud server, it provides basic data for the trainee to select a teacher according to personal hobbies when learning dance.

8. A virtual reality-based dance training system according to claim 7, characterized in that: The correction module corrects the wrong actions of the trainee in the practice module. The somatosensory peripheral device captures the dance motion information of the trainee and uploads the motion information to the recognition module. According to the motion information transmitted from the somatosensory peripheral device to the recognition module, it is compared with the dance course database stored in the recognition module, and the comparison information is transmitted to the VR virtual display device and the intelligent AI dialogue module. When a certain action of the trainee does not meet the standard, the dance course is paused, and the non-standard position of the action is marked in the virtual scene, and voice guidance is provided to prompt the trainee to repeat the previous action. After the trainee repeats the previous action to reach the standard, the dance course continues.

9. The virtual reality-based dance training system according to claim 8, characterized in that: The exercise module provides a basic scenario for trainees to practice dancing, urges trainees to correct non-standard movements during dancing, captures and collects the dancing movement information of trainees through a somatosensory peripheral device, and transmits it to the recognition module. The recognition module compares the dancing movement information of trainees with the data in the internal dance course package, and transmits the comparison information to the VR virtual display and intelligent AI dialogue module to provide voice guidance for trainees, enabling trainees to practice targeted.

10. A virtual reality-based dance training system according to claim 9, characterized in that: The scoring module scores each movement of the trainees' dance practice, and then conducts a comprehensive score. It captures and collects the dancing movement information of trainees through a somatosensory peripheral device, and transmits it to the recognition module. The recognition module compares and scores the dancing movement information of trainees with the data in the internal dance course package, and uploads the scoring information to the cloud server through the network module. The background can download this data in the cloud server, and special teachers can conduct offline interviews and tutoring according to the trainees' scores and difficulties.

Images