Teaching system and method based on VR virtual classroom

Abstract

The invention provides a teaching system and method based on a VR virtual classroom, and relates to the technical field of virtual reality, and the teaching system comprises an obtaining unit which is used for obtaining the limb node coordinates of a user; the first recognition unit is used for acquiring VR teaching actions corresponding to the VR limb guide model according to the limb node coordinates, the VR limb guide model and the action arrangement; the execution unit is used for executing VR teaching actions through the VR limb guiding model to perform teaching guiding; the second identification unit is used for acquiring an actual action formed by the coordinates of the limb nodes according to the change of the coordinates of the limb nodes in the VR teaching action teaching process; the comparison unit is used for comparing the actual action with the VR teaching action to obtain a comparison result; and the generation unit is used for generating a next teaching plan corresponding to the action arrangement according to the comparison result. According to the teaching system and method, the learning enthusiasm and learning ability of the user can be improved on the premise of ensuring the teaching quality.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a teaching system and method based on a VR virtual classroom. Background Art

[0002] Over the long course of human evolution, humans have developed a division of labor between the upper and lower limbs. This, combined with the movement of the trunk, allows for a wide variety of human movements. The shapes and postures that these limb movements manifest can be called movement forms.

[0003] Existing users lack professional guidance when learning body movements, due to a lack of teaching resources and high costs of private tutoring. This leads to poor learning outcomes, making it difficult to quickly and accurately master the essentials of different postures, and it is also difficult to grasp the accuracy of the postures. Injuries often occur due to incorrect movements or movements that are not difficult enough for the user. Summary of the Invention

[0004] The present invention provides a teaching system and method based on VR virtual classroom to solve the technical problems in the prior art that users lack professional guidance in learning body movements, resulting in poor learning effects, difficulty in quickly and accurately mastering the essentials of different postures, and difficulty in grasping the accuracy of postures.

[0005] To achieve the above-mentioned and other related purposes, the present invention provides a teaching system based on a VR virtual classroom, comprising: an acquisition unit for acquiring the coordinates of a user's limb nodes; a first recognition unit for acquiring, based on the limb node coordinates, a VR limb guidance model and an action choreography, a VR teaching action corresponding to the VR limb guidance model; an execution unit for executing the VR teaching action through the VR limb guidance model for teaching guidance; a second recognition unit for acquiring, during the teaching process of the VR teaching action, the actual action formed by the limb node coordinates based on the changes in the limb node coordinates; a comparison unit for comparing the actual action with the VR teaching action to obtain a comparison result; and a generation unit for generating, based on the comparison result, a next teaching plan corresponding to the action choreography.

[0006] In one embodiment of the present invention, a model construction subunit is also included; the model construction subunit includes: a monitoring module, which is used to monitor the user's limb node coordinates through a sensor module; a coordinate configuration module, which is used to use the limb node coordinates corresponding to the preset position as the model calibration coordinate when the limb node is in a preset position; and a model adjustment module, which is used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain a VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting the limb proportions.

[0007] In one embodiment of the present invention, the first recognition unit includes: an action recognition subunit, which is used to obtain the user action speed and user action trend of the corresponding limb node according to the change of the limb node coordinates; a speed calculation subunit, which is used to obtain the model action speed corresponding to the VR limb guidance model according to the user action speed and action choreography; a trend calculation subunit, which is used to obtain the model action trend corresponding to the VR limb guidance model according to the user action trend and action choreography; and an action adjustment subunit, which is used to adjust the basic model action speed and basic model action trend of action simulation teaching through the VR limb guidance model according to the model action speed and model action trend, and obtain the VR teaching action corresponding to the VR limb guidance model; wherein, the VR teaching action corresponding to the VR limb guidance model is an advance demonstration of the actual action.

[0008] In one embodiment of the present invention, the speed calculation subunit includes: a speed query module, which is used to obtain the basic model movement speed corresponding to the VR limb guidance model based on the movement arrangement; a speed comparison module, which is used to compare the user movement speed and the basic model movement speed to obtain the difference speed; an increase calculation module, which is used to obtain the speed increase based on the difference speed and the movement proficiency parameter; and a speed conversion module, which is used to obtain the model movement speed corresponding to the VR limb guidance model based on the difference speed and the speed increase.

[0009] In one embodiment of the present invention, the trend calculation subunit includes: a fragment query module, which is used to obtain a set of model action trend fragments corresponding to the VR limb guidance model based on the action arrangement, the model action trend fragment set including a plurality of model action trend fragments arranged in a sequence of action execution; an interception module, which is used to intercept the user action trend to obtain a user action trend fragment, wherein the user action trend fragment is an action trend fragment consisting of the user's current action and its previous actions; a trend comparison module, which is used to compare the user action trend fragment with the current model action trend fragment; a first output module, which is used to, when the difference between the user action trend fragment and the current model action trend fragment is less than a set value, use the current model action trend fragment and the subsequent model action trend fragments arranged in a sequence of action execution as the model action trend corresponding to the VR limb guidance model; and a second output module, which is used to, when the difference between the user action trend fragment and the current model action trend fragment is greater than a set value, search for the model action trend fragment with the smallest difference from the user action trend, and use the model action trend fragment with the smallest difference from the user action trend and the subsequent model action trend fragments arranged in a sequence of action execution as the model action trend corresponding to the VR limb guidance model.

[0010] In one embodiment of the present invention, the comparison unit includes: a curve generation subunit, which is used to obtain an actual action curve based on the actual action; a curve comparison subunit, which is used to compare the actual action curve with the teaching action curve of the VR teaching action to obtain the action difficulty; a completion calculation subunit, which is used to calculate the completion of the action difficulty based on the actual action curve and the teaching action curve of the VR teaching action to obtain the difficulty completion; and a result output subunit, which is used to use the action difficulty and the difficulty completion as comparison results.

[0011] In one embodiment of the present invention, the completion calculation subunit includes: a vertex search module, which is used to find the actual trajectory vertex of the actual action curve corresponding to the action difficulty and the target trajectory vertex of the teaching action curve; a first indicator calculation module, which is used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain a first difference indicator; a second indicator calculation module, which is used to compare the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex to obtain a second difference indicator; a third indicator calculation module, which is used to compare the degree of overlap between the first normal of the actual trajectory vertex in the actual action curve and the second normal of the target trajectory vertex in the teaching action curve to obtain a third difference indicator; and a comprehensive calculation module, which is used to obtain the completion degree of the difficulty based on the first difference indicator, the second difference indicator and the third difference indicator.

[0012] In one embodiment of the present invention, the comparison result includes the movement difficulty and the difficulty completion degree; the generation unit includes: a completion degree comparison subunit, configured to compare the current difficulty completion degree of each movement difficulty of the current teaching plan with the historical difficulty completion degree of each movement difficulty in the movement difficulty set corresponding to the previous teaching plan; a first generation subunit, configured to, when the current difficulty completion degree and the historical difficulty completion degree under the set number of teaching plans show a stable trend, obtain the first difficulty completion degree increment based on the average difficulty completion degree corresponding to the stable trend, so as to generate the next teaching plan corresponding to the movement choreography based on the first difficulty completion degree increment; The second generating sub-unit is used to obtain the second difficulty completion value according to the increase in the difficulty completion value corresponding to the upward trend when the completion degree of the current difficulty shows an upward trend, and generate the next teaching plan corresponding to the action choreography according to the second difficulty completion value; and the third generating sub-unit is used to disassemble the teaching action curve corresponding to the action difficulty when the completion degree of the current difficulty shows a downward trend compared with the historical difficulty completion degree under the set teaching plan number, obtain the disassembled action, and generate the next teaching plan corresponding to the action choreography according to the current difficulty completion degree and the disassembled action.

[0013] In one embodiment of the present invention, the second generating sub-unit includes: an increase degree calculation module, which is used to obtain the increase degree of difficulty completion based on the completion difference between the current difficulty completion degree and each adjacent two difficulty completion degrees in the historical difficulty completion degrees; an adjustment degree calculation module, which is used to obtain the value-added adjustment degree based on the current difficulty completion degree; an value-added calculation module, which is used to adjust the increase degree of difficulty completion through the value-added adjustment degree to obtain the second difficulty completion value-added; and a plan generation module, which is used to generate the next teaching plan corresponding to the action choreography based on the second difficulty completion value-added.

[0014] To achieve the above-mentioned purpose and other related purposes, the present invention also provides a teaching method based on a VR virtual classroom, comprising: obtaining the user's limb node coordinates through an acquisition unit; obtaining the VR teaching action corresponding to the VR limb guidance model according to the limb node coordinates, the VR limb guidance model and the action choreography through a first recognition unit; executing the VR teaching action through the VR limb guidance model to perform teaching guidance through an execution unit; obtaining the actual action formed by the limb node coordinates according to the changes in the limb node coordinates during the VR teaching action teaching process through a second recognition unit; comparing the actual action with the VR teaching action through a comparison unit to obtain a comparison result; and generating the next teaching plan corresponding to the action choreography according to the comparison result through a generation unit.

[0015] Beneficial effects of the present invention: The present invention proposes a teaching system and method based on a VR virtual classroom, which can realize interactive learning between the user's actual movements and the VR teaching movements of the VR limb guidance model by collecting the coordinate data of the user's limb nodes, so as to ensure that the VR teaching movements of the VR limb guidance model can effectively help the user learn, and can also adjust the teaching plan for the user's next corresponding movement according to the user's learning situation, so that users with different learning abilities can all learn effectively, and also avoid injuries to limbs, joints, etc. caused by directly using standard movements that are relatively difficult for users, while ensuring the quality of teaching, through gradual adjustment. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be derived from these drawings without inventive effort.

[0017] In the attached figure:

[0018] Figure 1 A structural block diagram of a teaching system based on a VR virtual classroom provided by an embodiment of the present invention;

[0019] Figure 2 Shown is a flowchart of a teaching method based on a VR virtual classroom provided by one embodiment of the present invention.

[0020] The reference numerals are as follows:

[0021] Acquisition unit 111; first recognition unit 112; execution unit 113; second recognition unit 114; comparison unit 115; generation unit 116. DETAILED DESCRIPTION

[0022] The following describes the embodiments of the present invention through specific examples. Those skilled in the art will readily understand the other advantages and benefits of the present invention from the disclosure herein. The present invention may also be implemented or applied through various other specific embodiments. The details in this specification may be modified or altered based on different viewpoints and applications without departing from the spirit of the present invention. The following embodiments and features therein may be combined with one another without conflict.

[0023] It should be noted that the illustrations provided in the following embodiments are merely schematic illustrations of the basic concept of the present invention. The drawings only show components related to the present invention and are not drawn according to the number, shape, and size of components in actual implementation. In actual implementation, the type, quantity, and proportion of each component may be changed arbitrarily, and the component layout may also be more complex.

[0024] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the embodiments of the present invention may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring the embodiments of the present invention.

[0025] See also Figure 1The present invention provides a teaching system based on a VR virtual classroom, comprising: an acquisition unit 111, for acquiring the coordinates of a user's limb nodes; a first recognition unit 112, for acquiring a VR teaching action corresponding to the VR limb guidance model according to the limb node coordinates, the VR limb guidance model and the action choreography; an execution unit 113, for executing the VR teaching action through the VR limb guidance model to perform teaching guidance; a second recognition unit 114, for acquiring the actual action formed by the limb node coordinates according to the changes in the limb node coordinates during the teaching process of the VR teaching action; a comparison unit 115, for comparing the actual action with the VR teaching action to obtain a comparison result; and a generation unit 116, for generating a next teaching plan corresponding to the action choreography according to the comparison result.

[0026] When using the teaching system of the present invention to teach postures, movements, etc., for example, it can be dance teaching, martial arts teaching, and of course, it can also be teaching other types of human postures and movements. Specifically, during teaching, the acquisition unit 111 can be used to obtain the limb node coordinates of each limb node in various parts of the user's body, and then the first recognition module 112 uses the set VR limb guidance model and action choreography to generate VR teaching movements for the VR limb guidance model to execute. Then, the execution unit 113 executes the VR limb guidance model in sequence according to the VR teaching movement, thereby forming teaching movements corresponding to the limb node coordinates, so that users can watch and learn through VR tools such as VR headsets. At the same time, the second recognition unit 114 will also generate corresponding actual movements according to the real-time changes in the limb node coordinates during the VR teaching movement teaching process. The actual action and the VR teaching action are then compared by the comparison unit 115 to determine the gap between the actual action of the current user and the VR teaching action, so as to adaptively adjust the action difficulty of the VR limb guidance model when executing the VR teaching action, so as to avoid injuries to limbs, joints, etc. caused by directly using standard actions which are more difficult for the user. Under the premise of ensuring the teaching quality, the user's learning enthusiasm and learning ability can be improved through gradual adjustment.

[0027] The teaching system based on VR virtual classroom of the present invention may further include a model construction subunit; the model construction subunit includes: a monitoring module, which is used to monitor the user's limb node coordinates through a sensor module; a coordinate configuration module, which is used to use the limb node coordinates corresponding to the preset position as the model calibration coordinates when the limb node is in a preset position; and a model adjustment module, which is used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain a VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting the limb proportions.

[0028] Before using the teaching system of the present invention for instruction, the model building subunit can be used to recalibrate the VR basic limb guidance model's model baseline. This allows the model to be adapted for different populations based on the determined positions of the same limb nodes for different populations. Specifically, the monitoring module first captures sensor data to monitor the coordinates of each user's limb nodes. Alternatively, a camera can be used to capture images of the user's movements, then identify the limb nodes in the images to determine the corresponding limb node coordinates. The user can then place the coordinates of each limb node at a preset position, and the coordinate configuration module can then retrieve the limb node coordinates at the preset position to serve as the model calibration coordinates. This preset position can be the limb node coordinates of each limb node in an upright position, or any other conveniently set position. The model adjustment module then adjusts the VR basic limb guidance model based on the preset limb proportions, using the model calibration coordinates as the basis for re-updating the VR limb guidance model. In this way, the proportions of limb length, width, and other aspects of the VR basic limb guidance model can be adjusted to suit the user's actual needs. For example, when the shoulder node coordinates and wrist node coordinates of the human body in an upright state are monitored, the distance between the shoulder node and the wrist node in the VR basic limb guidance model can be adjusted accordingly. Similarly, the limb proportions of the VR basic limb guidance model can be adjusted to correspond to the user, thereby obtaining a VR limb guidance model to match the user's teaching movements, so as to accurately determine whether the user can meet the standard requirements when performing movements of each limb node during learning.

[0029] In the teaching system based on the VR virtual classroom of the present invention, the first recognition unit 112 includes: an action recognition subunit, which is used to obtain the user action speed and user action trend of the corresponding limb node according to the change of the limb node coordinates; a speed calculation subunit, which is used to obtain the model action speed corresponding to the VR limb guidance model according to the user action speed and action choreography; a trend calculation subunit, which is used to obtain the model action trend corresponding to the VR limb guidance model according to the user action trend and action choreography; and an action adjustment subunit, which is used to adjust the basic model action speed and basic model action trend of action simulation teaching through the VR limb guidance model according to the model action speed and model action trend, and obtain the VR teaching action corresponding to the VR limb guidance model; wherein, the VR teaching action corresponding to the VR limb guidance model is an advance demonstration of the actual action.

[0030] When the first recognition unit 112 is used to identify VR teaching actions that the VR limb guidance model needs to perform, the action recognition subunit can first determine the user action speed and user action trend of the corresponding limb node based on the real-time change information of the limb node coordinates. For example, the movement amount of each limb node per unit time can be determined as the user action speed; the linearity of the current limb node can also be obtained as the user action trend using the least squares method based on the current limb node coordinates and the limb node coordinates at adjacent moments; of course, the user action trend can also be obtained through other methods.

[0031] Furthermore, the speed calculation subunit includes: a speed query module, which is used to obtain the basic model movement speed corresponding to the VR limb guidance model according to the movement arrangement; a speed comparison module, which is used to compare the user movement speed and the basic model movement speed to obtain the difference speed; an increase calculation module, which is used to obtain the speed increase according to the difference speed and the movement proficiency parameter; and a speed conversion module, which is used to obtain the model movement speed corresponding to the VR limb guidance model according to the difference speed and the speed increase.

[0032] When the speed calculation subunit calculates the model action speed corresponding to the VR limb guidance model, the speed query module can be used to obtain the basic model action speed set based on the action arrangement. The basic model action speed corresponds to the minimum action speed that the VR limb guidance model can perform. Then, the obtained user action speed and the basic model action speed are compared according to the speed comparison module, so as to obtain the difference speed between the two, so as to provide a reference for the current user action speed through the basic model action speed. And after determining the difference speed, the current user's action proficiency parameter can be used to further generate a speed increase to further control the model action speed corresponding to the VR limb guidance model, so as to prevent the VR limb guidance model from having its actions far exceed the user's actions during teaching, which makes it difficult to match the speed and affects the teaching effect.

[0033] Specifically, in the process of calculating the action proficiency parameter, the calculation formula of the action proficiency parameter is: , Indicates the user's action speed, Indicates the basic model movement speed, Indicates the baseline model movement speed.

[0034] In the process of calculating the model motion speed, the calculation formula of the model motion speed is: , Indicates speed increase, speed increase By action proficiency parameters Look up the table to get the proficiency parameters of each action Corresponding to a speed increase range value, by determining the speed increase The speed increase range value is used to obtain the corresponding action proficiency parameters .

[0035] In addition, the following requirements must be met: Model movement speed Less than or equal to the baseline model movement speed ; To ensure the speed of the model Reaching the baseline model motion speed , it means that the current user's action learning has been completed according to standardization.

[0036] In addition, the trend calculation subunit includes: a fragment query module, which is used to obtain a set of model action trend fragments corresponding to the VR limb guidance model according to the action arrangement, and the model action trend fragment set includes several model action trend fragments arranged in the order of action execution; an interception module, which is used to intercept the user action trend and obtain a user action trend fragment, and the user action trend fragment is an action trend fragment composed of the user's current action and its previous action; a trend comparison module, which is used to compare the user action trend fragment with the current model action trend fragment; a first output module, which is used to use the current model action trend fragment and the subsequent model action trend fragments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model when the difference between the user action trend fragment and the current model action trend fragment is less than a set value; and a second output module, which is used to find the model action trend fragment with the smallest difference from the user action trend when the difference between the user action trend fragment and the current model action trend fragment is greater than a set value, and use the model action trend fragment with the smallest difference from the user action trend and the subsequent model action trend fragments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model.

[0037] When the trend calculation subunit calculates the model motion trend corresponding to the VR limb guidance model, it can use the fragment query module to utilize the action choreography to find the corresponding model motion trend fragment set. Furthermore, within the model motion trend fragment set, each model motion trend fragment is arranged in the order of action execution. When the user performs an action, the interception module intercepts the current action and its preceding actions based on the current action to form a corresponding motion trend fragment. The trend comparison module then compares the user's motion trend fragment with the current model motion trend fragment. If the difference between the two is less than a set value, the current model motion trend fragment and the subsequent model motion trend fragments arranged in the order of action execution are selected as the model motion trend corresponding to the VR limb guidance model. If the difference between the two is greater than a set value, it indicates that the user may be performing another action. Therefore, it is necessary to further search for the model motion trend fragment with the smallest difference from the user's motion trend. This model motion trend fragment and the subsequent model motion trend fragments arranged in the order of action execution are selected as the model motion trend corresponding to the VR limb guidance model for execution by the VR limb guidance model.

[0038] The calculation formula for the difference between the user action trend segment and the current model action trend segment is: ,in, Represented as the coordinates of each point in the user action trend segment, Represented as the coordinates of each point in the current model action trend segment, Indicates the number of selected points in the user action trend segment / current model action trend segment.

[0039] In the teaching system based on the VR virtual classroom of the present invention, the comparison unit 115 includes: a curve generation subunit, which is used to obtain an actual action curve according to the actual action; a curve comparison subunit, which is used to compare the actual action curve with the teaching action curve of the VR teaching action to obtain the action difficulty; a completion calculation subunit, which is used to calculate the completion of the action difficulty according to the actual action curve and the teaching action curve of the VR teaching action to obtain the difficulty completion; and a result output subunit, which is used to use the action difficulty and the difficulty completion as the comparison result.

[0040] When the comparison unit 115 compares the actual action with the VR teaching action, the curve generation subunit can be used to draw the actual action curve based on the actual action of the user when following the VR teaching action. Then, the curve comparison subunit compares the actual action curve with the teaching action curve of the VR teaching action to determine the completion of the current user's action, thereby finding the action difficulty when the user performs the action. At the same time, the completion degree calculation subunit will calculate the completion degree of each action difficulty to obtain the difficulty completion degree. Finally, the result output subunit sends the action difficulty and difficulty completion degree as the comparison result to the generation unit 116, so that the generation unit 116 uses the action difficulty and difficulty completion degree to generate the teaching plan for the next teaching of the user, so as to ensure that the user's learning is improved every time.

[0041] Furthermore, the completion calculation subunit includes: a vertex search module, which is used to find the actual trajectory vertex of the actual action curve corresponding to the action difficulty and the target trajectory vertex of the teaching action curve; a first indicator calculation module, which is used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain a first difference indicator; a second indicator calculation module, which is used to compare the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex to obtain a second difference indicator; a third indicator calculation module, which is used to compare the degree of overlap between the first normal of the actual trajectory vertex in the actual action curve and the second normal of the target trajectory vertex in the teaching action curve to obtain a third difference indicator; and a comprehensive calculation module, which is used to obtain the completion degree of the difficulty based on the first difference indicator, the second difference indicator and the third difference indicator.

[0042] When the completion degree calculation sub-unit calculates the difficulty completion degree of the action difficulty, since the difficulty completion degree of the action difficulty is mainly affected by the distance between the actual trajectory vertex and the target trajectory vertex, the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex, and the overlap degree of the first normal of the actual action curve of the actual trajectory vertex and the second normal of the target trajectory vertex in the teaching action curve, the corresponding first difference index, second difference index and third difference index can be calculated, and then the difficulty completion degree under the comprehensive index can be determined through the comprehensive calculation module.

[0043] When calculating the first difference index, the calculation formula of the first difference index can be expressed as: , the actual trajectory vertex is recorded as , the vertex of the target trajectory is recorded as , Represents the first weighting factor.

[0044] When calculating the second difference index, the calculation formula of the second difference index can be expressed as , represents the second weight factor, Represents the area of ​​the actual action curve segment corresponding to the vertex of the actual trajectory, Represents the area of ​​the teaching action curve segment corresponding to the vertex of the target trajectory.

[0045] When calculating the third difference index, the calculation formula of the third difference index can be expressed as , represents the third weight factor, Indicates the slope of the first normal line of the actual trajectory vertex corresponding to the actual action curve, Indicates the slope of the second normal line corresponding to the target trajectory vertex on the teaching action curve.

[0046] Based on the first difference index, second difference index and third difference index calculated by the mobile phone, the completion degree of the difficulty point can be further calculated. .

[0047] In addition, the comparison results mainly include the difficulty of the movements and the degree of completion of the difficulty. After obtaining the comparison results, the next teaching plan for the user can be determined based on the comparison results, thereby ensuring that each teaching plan can be adaptively adjusted according to the user's performance.

[0048] In the teaching system based on VR virtual classroom of the present invention, the generation unit 116 includes: a completion comparison subunit, which is used to compare the completion degree of the current difficulty of each action difficulty of the current teaching plan with the historical difficulty completion degree of each action difficulty in the action difficulty set corresponding to the previous teaching plan; a first generation subunit, which is used to obtain the first difficulty completion value according to the mean value of the difficulty completion corresponding to the stable trend when the current difficulty completion degree and the historical difficulty completion degree under the set teaching plan number show a stable trend, so as to generate the next teaching plan corresponding to the action choreography according to the first difficulty completion value; a second generation subunit, which is used to obtain the first difficulty completion value according to the mean value of the difficulty completion corresponding to the stable trend when the current difficulty completion degree and the historical difficulty completion degree under the set teaching plan number show a stable trend A generating subunit is used to obtain the second difficulty completion value according to the increasing degree of the difficulty completion corresponding to the increasing trend when the completion degree of the current difficulty shows an upward trend, and generate the next teaching plan corresponding to the action choreography according to the increasing degree of the second difficulty completion; and a third generating subunit is used to disassemble the teaching action curve corresponding to the action difficulty when the completion degree of the current difficulty shows a downward trend compared with the historical difficulty completion degree under the set teaching plan number, obtain the disassembled action, and generate the next teaching plan corresponding to the action choreography according to the completion degree of the current difficulty and the disassembled action.

[0049] When generating the next teaching plan for the choreography based on the difficulty level and completion level of each movement, the generation unit 116 can compare the current completion level of each movement difficulty with the previous completion levels of each historical difficulty level, thereby determining whether the current user's movement has improved. If the comparison shows a stable trend in the completion levels of each movement, it indicates that the user needs to increase the difficulty level. Based on the average completion level of each difficulty level corresponding to the stable trend, a first difficulty level increment can be generated. The first difficulty level increment can then be used to generate the next teaching plan for the choreography. Specifically, after obtaining the average completion level of each difficulty level, the difficulty level can be appropriately increased according to a preset ratio to ensure that the user can continue to improve and achieve the standard movement. If the comparison shows an upward trend, it indicates that the user's completion level can be significantly improved. Therefore, the difficulty level of the VR limb guidance model can be increased during the next choreography to meet the needs of users with different abilities and accelerate their learning progress. Finally, when comparing, if there is a downward trend, it means that the current action is relatively difficult for the user. In the next teaching plan, it is necessary to further decompose each VR teaching action performed by the VR limb guidance model into different degrees according to the degree of the downward trend to ensure that users with poor foundations can also learn effectively.

[0050] Among them, the second generation sub-unit includes: an increase degree calculation module, which is used to obtain the increase degree of difficulty completion based on the completion difference between the current difficulty completion degree and the completion degree of each two adjacent difficulty points in the historical difficulty completion degrees; an adjustment degree calculation module, which is used to obtain the value-added adjustment degree based on the current difficulty completion degree; an value-added calculation module, which is used to adjust the increase degree of difficulty completion through the value-added adjustment degree to obtain the second difficulty completion value-added; and a plan generation module, which is used to generate the next teaching plan corresponding to the action choreography based on the second difficulty completion value-added.

[0051] When the second generation subunit uses the rising trend to generate the next teaching plan corresponding to the action choreography, it can be that the difference between the completion degree of the current and historical difficulty points can be calculated through the rising degree calculation module, so as to determine the user's degree of improvement in completing the action, that is, the difficulty point completion degree rising degree. At the same time, the difficulty point completion degree of this time can be realized through the adjustment degree calculation module to determine the corresponding value-added adjustment degree, wherein the value-added adjustment degree can be obtained by looking up the table according to the difficulty point completion degree. After obtaining the value-added adjustment degree, the difficulty point completion degree rising degree can be further adjusted through the value-added calculation module to obtain the second difficulty point completion value-added. Then, the plan generation module uses the calculated second difficulty point completion value-added to generate the next teaching plan corresponding to the action choreography to determine whether the user's learning process can be further accelerated.

[0052] Specifically, when calculating the value-added of the completion degree of the second difficulty point, the calculation formula for the value-added of the completion degree of the second difficulty point can be: ,in, Indicates the degree of difficulty completion. Indicates the completion degree of this difficulty. Indicates the adjustment factor.

[0053] Referring to 2, the present invention further provides a teaching method based on a VR virtual classroom, comprising:

[0054] Step S10: obtaining the coordinates of the user's limb nodes through the obtaining unit;

[0055] Step S20: obtaining VR teaching movements corresponding to the VR limb guidance model according to the limb node coordinates, the VR limb guidance model, and the movement choreography by the first recognition unit;

[0056] Step S30: The execution unit performs VR teaching actions through the VR limb guidance model to provide teaching guidance;

[0057] Step S40: obtaining the actual movement formed by the limb node coordinates according to the changes in the limb node coordinates during the VR teaching movement teaching process through the second recognition unit;

[0058] Step S50: Comparing the actual action with the VR teaching action through a comparison unit to obtain a comparison result;

[0059] Step S60: The generating unit generates a next teaching plan corresponding to the action choreography according to the comparison result.

[0060] In summary, the present invention discloses a teaching system and method based on VR virtual classroom, which can realize interactive learning between the user's actual action and the VR teaching action of the VR limb guidance model by collecting the coordinate data of the user's limb nodes, so as to ensure that the VR teaching action of the VR limb guidance model can effectively help the user learn, and can also adjust the teaching plan for the user's next time corresponding to the same action according to the user's learning situation, so that users with different learning abilities can all learn effectively, and also avoid injuries to limbs, joints, etc. caused by the direct use of standard actions due to the relative difficulty of the user, while ensuring the quality of teaching, by gradually adjusting the method. Therefore, the present invention effectively overcomes the various shortcomings in the prior art and has high industrial utilization value.

[0061] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the present invention. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical principles disclosed herein are intended to be covered by the claims of the present invention.

Claims

1. A teaching system based on VR virtual classroom, characterized by: include: An acquisition unit, used to obtain the coordinates of the user's limb nodes; A first recognition unit is configured to obtain a VR teaching action corresponding to the VR limb guidance model according to the limb node coordinates, the VR limb guidance model, and the action choreography; An execution unit, configured to perform the VR teaching action to provide teaching guidance through the VR limb guidance model; A second recognition unit is used to obtain the actual movement formed by the limb node coordinates according to the changes of the limb node coordinates during the VR teaching movement teaching process; a comparing unit, configured to compare the actual action with the VR teaching action to obtain a comparison result; as well as A generating unit is used to generate a next teaching plan corresponding to the action choreography according to the comparison result.

2. The teaching system based on VR virtual classroom according to claim 1, characterized in that: It also includes a model building subunit; The model building subunit includes: A monitoring module, configured to monitor the coordinates of the user's limb nodes through a sensor module; a coordinate configuration module, configured to use the limb node coordinates corresponding to the preset position as model calibration coordinates when the limb node is at the preset position; and The model adjustment module is used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain the VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting the limb proportions.

3. The teaching system based on VR virtual classroom according to claim 1, characterized in that: The first recognition unit includes: an action recognition subunit, configured to obtain a user action speed and a user action trend of a corresponding limb node according to changes in the coordinates of the limb node; a speed calculation subunit, configured to obtain a model movement speed corresponding to the VR limb guidance model according to the user movement speed and the movement choreography; a trend calculation subunit, configured to obtain a model motion trend corresponding to the VR limb guidance model according to the user motion trend and the motion choreography; and an action adjustment subunit, configured to adjust the basic model action speed and basic model action trend for action simulation teaching using the VR limb guidance model according to the model action speed and the model action trend, and obtain VR teaching actions corresponding to the VR limb guidance model; The VR teaching action corresponding to the VR limb guidance model is an advance demonstration of the actual action.

4. The teaching system based on VR virtual classroom according to claim 3 is characterized in that: The speed calculation subunit includes: A speed query module, configured to obtain a basic model movement speed corresponding to the VR limb guidance model according to the movement choreography; A speed comparison module, configured to compare the user's motion speed with the base model's motion speed to obtain a speed difference; an increase calculation module, configured to obtain a speed increase according to the speed difference and the movement proficiency parameter; and The speed conversion module is used to obtain the model movement speed corresponding to the VR limb guidance model according to the difference speed and the speed increase.

5. The teaching system based on VR virtual classroom according to claim 3 is characterized in that: The trend calculation subunit includes: a segment query module, configured to obtain, based on the action choreography, a set of model action trend segments corresponding to the VR limb guidance model, wherein the set of model action trend segments includes a plurality of model action trend segments arranged in a sequence of action execution; An interception module is used to intercept the user action trend to obtain a user action trend segment, wherein the user action trend segment is an action trend segment consisting of the user's current action and its previous actions; a trend comparison module, configured to compare the user action trend segment with the current model action trend segment; a first output module configured to, when a difference between the user motion trend segment and the current model motion trend segment is less than a set value, use the current model motion trend segment and the subsequent model motion trend segments arranged in a sequence of motion execution as the model motion trends corresponding to the VR limb guidance model; and The second output module is used to search for the model action trend segment with the smallest difference from the user action trend when the difference between the user action trend segment and the current model action trend segment is greater than a set value, and use the model action trend segment with the smallest difference from the user action trend and the model action trend segments arranged in the order of action execution thereafter as the model action trends corresponding to the VR limb guidance model.

6. The teaching system based on VR virtual classroom according to claim 1, characterized in that: The comparison unit includes: a curve generating subunit, configured to obtain an actual action curve according to the actual action; A curve comparison subunit, configured to compare the actual action curve with the teaching action curve of the VR teaching action to obtain the difficulty of the action; a completion degree calculation subunit, configured to calculate the completion degree of the difficulty point of the movement based on the actual movement curve and the teaching movement curve of the VR teaching movement, and obtain the completion degree of the difficulty point; and The result output subunit is used to use the action difficulty and the completion degree of the difficulty as the comparison result.

7. The teaching system based on VR virtual classroom according to claim 6, characterized in that: The completion degree calculation subunit includes: A vertex search module, used for searching the actual trajectory vertex of the actual action curve and the target trajectory vertex of the teaching action curve corresponding to the action difficulty; A first index calculation module is used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain a first difference index; a second index calculation module, configured to compare a curve difference between an actual action curve segment corresponding to a vertex of the actual trajectory and a teaching action curve segment corresponding to a vertex of the target trajectory to obtain a second difference index; A third index calculation module is used to compare the degree of overlap of the actual trajectory vertex on the first normal line of the actual action curve with the second normal line of the target trajectory vertex on the teaching action curve to obtain a third difference index; and A comprehensive calculation module is used to obtain the completion degree of the difficult points based on the first difference index, the second difference index and the third difference index.

8. The teaching system based on VR virtual classroom according to claim 1, characterized in that: The comparison results include the difficulty of the action and the degree of completion of the difficulty; The generating unit includes: The completion comparison subunit is used to compare the completion degree of each difficulty point of the current teaching plan with the historical completion degree of each difficulty point in the corresponding difficulty point set of the previous teaching plan; A first generating subunit is configured to obtain a first difficulty completion value increment based on an average of the difficulty completion values ​​corresponding to the stable trend when the current difficulty completion value and the historical difficulty completion values ​​under the set teaching plan times show a stable trend, so as to generate a next teaching plan corresponding to the movement choreography based on the first difficulty completion value increment; A second generating subunit is configured to, when the completion degree of the current difficulty point and the completion degree of the historical difficulty points under the set teaching plan times show an upward trend, obtain a second difficulty point completion value according to the difficulty point completion value increase corresponding to the upward trend, and generate a next teaching plan corresponding to the action choreography according to the second difficulty point completion value increase; and The third generating sub-unit is used to disassemble the teaching action curve corresponding to the action difficulty when the completion degree of the current difficulty and the completion degree of the historical difficulty under the set teaching plan number show a downward trend, obtain the disassembled action, and generate the next teaching plan corresponding to the action choreography based on the completion degree of the current difficulty and the disassembled action.

9. The teaching system based on VR virtual classroom according to claim 8, characterized in that: The second generating subunit includes: an increase degree calculation module, configured to obtain an increase degree of difficulty point completion based on the completion degree difference between the current difficulty point completion degree and the completion degrees of each two adjacent difficulty points in the historical difficulty point completion degrees; An adjustment degree calculation module, configured to obtain a value-added adjustment degree based on the completion degree of the current difficulty; a value-added calculation module, configured to adjust the difficulty completion degree increase by the value-added adjustment degree to obtain a second difficulty completion degree value-added; and A plan generating module is used to generate a next teaching plan corresponding to the action choreography according to the increment of the completion degree of the second difficulty point.

10. A teaching method based on VR virtual classroom, characterized in that: include: Obtain the coordinates of the user's limb nodes through the acquisition unit; Obtaining, by a first recognition unit, a VR teaching action corresponding to the VR limb guidance model according to the limb node coordinates, the VR limb guidance model, and the action choreography; The execution unit uses the VR limb guidance model to execute the VR teaching action to perform teaching guidance; During the VR teaching action teaching process, the second recognition unit obtains the actual action formed by the limb node coordinates according to the changes in the limb node coordinates; Comparing the actual action with the VR teaching action by a comparison unit to obtain a comparison result; The generating unit generates a next teaching plan corresponding to the action choreography according to the comparison result.

Images