A teaching system and method based on a VR virtual classroom
By acquiring the coordinates of users' limb nodes through a VR virtual classroom teaching system, using a VR limb guidance model to guide teaching movements, and comparing actual movements with teaching movements in real time, an adaptively adjusted teaching plan is generated. This solves the problem of users lacking professional guidance in limb movement learning, and improves learning effectiveness and safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- JIANGSU FOOD & PHARMA SCI COLLEGE
- Filing Date
- 2025-07-01
- Publication Date
- 2026-08-04
AI Technical Summary
In existing technologies, users lack professional guidance in learning body movements, resulting in poor learning outcomes. It is difficult to quickly and accurately master the key points of different postures, and it is also difficult to grasp the accuracy of the postures, which can easily lead to injury due to incorrect movements or mismatched difficulty.
The VR-based virtual classroom teaching system acquires the coordinates of users' limb nodes, uses a VR limb guidance model to guide teaching movements, and compares the actual movements with the teaching movements in real time to generate adaptively adjusted teaching plans, avoiding injuries caused by excessively difficult movements.
It enables interactive learning between users and VR body guidance models, adaptively adjusts the difficulty of movements, enhances learning motivation and ability, ensures teaching quality, and avoids injuries.
Smart Images
Figure CN120723071B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of virtual reality technology, and in particular to a teaching system and method based on VR virtual classroom. Background Technology
[0002] Over the long course of evolution, humans have achieved a division of labor between upper and lower limb movements, which, combined with trunk movements, results in a myriad of forms of human movement. The shapes and postures outwardly expressed by these limb movements can be called the forms of motion.
[0003] Due to a lack of teaching resources and high costs of private coaching, current users often lack professional guidance when learning physical movements, such as dance and fitness. This results in poor learning outcomes, difficulty in quickly and accurately mastering different postures, and difficulty in ensuring the accuracy of postures. Injuries often occur due to incorrect movements or movements that are not suitable for their own abilities. Summary of the Invention
[0004] This invention provides a teaching system and method based on VR virtual classroom to solve the technical problems in the prior art where users lack professional guidance in learning body movements, resulting in poor learning outcomes, difficulty in quickly and accurately mastering the key points of different postures, and difficulty in grasping the accuracy of postures.
[0005] To achieve the above and other related objectives, this invention provides a VR-based virtual classroom teaching system, comprising: an acquisition unit for acquiring the user's limb node coordinates; a first recognition unit for acquiring VR teaching actions corresponding to the VR limb guidance model based on the limb node coordinates, the VR limb guidance model, and the action choreography; an execution unit for executing VR teaching actions through the VR limb guidance model to provide teaching guidance; a second recognition unit for acquiring the actual action formed by the limb node coordinates based on changes in the limb node coordinates during the VR teaching action teaching process; a comparison unit for comparing the actual action with the VR teaching action and obtaining a comparison result; and a generation unit for generating the next teaching plan corresponding to the action choreography based on the comparison result.
[0006] In one embodiment of the present invention, a model building subunit is further included; the model building subunit includes: a monitoring module, used to monitor the coordinates of the user's limb nodes through a sensor module; a coordinate configuration module, used to use the coordinates of the limb node corresponding to the preset position as the model calibration coordinates when the limb node is in a preset position; and a model adjustment module, used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain the VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting the limb proportions.
[0007] In one embodiment of the present invention, the first recognition unit includes: an action recognition subunit, used to obtain the user action speed and user action trend of the corresponding limb node based on the change of limb node coordinates; a speed calculation subunit, used to obtain the model action speed corresponding to the VR limb guidance model based on the user action speed and action choreography; a trend calculation subunit, used to obtain the model action trend corresponding to the VR limb guidance model based on the user action trend and action choreography; and an action adjustment subunit, used to adjust the basic model action speed and basic model action trend for action simulation teaching through the VR limb guidance model based on the model action speed and model action trend, and obtain the VR teaching action corresponding to the VR limb guidance model; wherein, the VR teaching action corresponding to the VR limb guidance model is a pre-demonstration of the actual action.
[0008] In one embodiment of the present invention, the speed calculation subunit includes: a speed query module, used to obtain the basic model action speed corresponding to the VR limb guidance model according to the action choreography; a speed comparison module, used to compare the user action speed and the basic model action speed to obtain the difference speed; an amplification calculation module, used to obtain the speed amplification based on the difference speed and the action proficiency parameter; and a speed conversion module, used to obtain the model action speed corresponding to the VR limb guidance model according to the difference speed and the speed amplification.
[0009] In one embodiment of the present invention, the trend calculation subunit includes: a segment query module, used to obtain a set of model action trend segments corresponding to the VR limb guidance model according to the action arrangement, the set of model action trend segments including several segments of model action trend segments arranged in the order of action execution; a segmentation module, used to segment the user action trend to obtain user action trend segments, the user action trend segments being action trend segments composed of the user's current action and the actions before it; a trend comparison module, used to compare the user action trend segments with the current model action trend segments; a first output module, used to, when the difference between the user action trend segments and the current model action trend segments is less than a set value, use the current model action trend segments and the subsequent model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model; and a second output module, used to, when the difference between the user action trend segments and the current model action trend segments is greater than a set value, find the model action trend segment with the smallest difference from the user action trend, and use the model action trend segment with the smallest difference from the user action trend and the subsequent model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model.
[0010] In one embodiment of the present invention, the comparison unit includes: a curve generation subunit, used to obtain an actual action curve based on the actual action; a curve comparison subunit, used to compare the actual action curve with the teaching action curve of the VR teaching action to obtain the action difficulty; a completion calculation subunit, used to calculate the completion degree of the action difficulty based on the actual action curve and the teaching action curve of the VR teaching action to obtain the difficulty completion degree; and a result output subunit, used to use the action difficulty and the difficulty completion degree as the comparison result.
[0011] In one embodiment of the present invention, the completion calculation subunit includes: a vertex lookup module, used to find the actual trajectory vertex of the actual action curve corresponding to the action difficulty and the target trajectory vertex of the teaching action curve; a first index calculation module, used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain a first difference index; a second index calculation module, used to compare the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex to obtain a second difference index; a third index calculation module, used to compare the overlap between the first normal of the actual trajectory vertex on the actual action curve and the second normal of the target trajectory vertex on the teaching action curve to obtain a third difference index; and a comprehensive calculation module, used to obtain the completion degree of the difficulty based on the first difference index, the second difference index, and the third difference index.
[0012] In one embodiment of the present invention, the comparison result includes the difficulty of the action and the completion degree of the difficulty; the generation unit includes: a completion degree comparison subunit, used to compare the completion degree of the current difficulty of each action difficulty in the current teaching plan with the historical completion degree of each action difficulty in the set of action difficulties corresponding to the previous teaching plan; a first generation subunit, used to obtain a first difficulty completion degree increment based on the average difficulty completion degree corresponding to the stable trend when the completion degree of the current difficulty is stable compared with the historical difficulty completion degree under a set number of teaching plans, so as to generate the next teaching plan corresponding to the action arrangement based on the first difficulty completion degree increment; The second generation subunit is used when the completion rate of the current difficulty shows an upward trend compared to the historical completion rate of the difficulty under the set number of teaching plans. In this case, it obtains the increment of the completion rate of the second difficulty based on the increment of the completion rate of the difficulty under the upward trend, and generates the next teaching plan corresponding to the action choreography based on the increment of the completion rate of the second difficulty. The third generation subunit is used when the completion rate of the current difficulty shows a downward trend compared to the historical completion rate of the difficulty under the set number of teaching plans. In this case, it decomposes the teaching action curve corresponding to the action difficulty, obtains the decomposed actions, and generates the next teaching plan corresponding to the action choreography based on the completion rate of the current difficulty and the decomposed actions.
[0013] In one embodiment of the present invention, the second generation subunit includes: an ascent calculation module, used to obtain the ascent degree of difficulty completion based on the difference in completion degree between each two adjacent difficulty completion degrees in the current difficulty completion degree and the historical difficulty completion degree; an adjustment degree calculation module, used to obtain the value-added adjustment degree based on the current difficulty completion degree; a value-added calculation module, used to adjust the ascent degree of difficulty completion degree through the value-added adjustment degree to obtain the value-added degree of the second difficulty completion degree; and a plan generation module, used to generate the next teaching plan corresponding to the action choreography based on the value-added degree of the second difficulty completion degree.
[0014] To achieve the above and other related objectives, the present invention also provides a teaching method based on a VR virtual classroom, comprising: acquiring the user's limb node coordinates through an acquisition unit; acquiring VR teaching actions corresponding to the VR limb guidance model through a first recognition unit based on the limb node coordinates, the VR limb guidance model, and the action choreography; executing the VR teaching actions through the VR limb guidance model for teaching guidance through an execution unit; acquiring the actual actions formed by the limb node coordinates based on changes in the limb node coordinates during the VR teaching action teaching process through a second recognition unit; comparing the actual actions with the VR teaching actions through a comparison unit to obtain a comparison result; and generating the next teaching plan corresponding to the action choreography through a generation unit based on the comparison result.
[0015] The beneficial effects of this invention are as follows: The teaching system and method based on VR virtual classroom proposed in this invention can achieve interactive learning between the user's actual movements and the VR teaching movements of the VR limb guidance model by collecting the coordinate data of the user's limb nodes. This ensures that the VR teaching movements of the VR limb guidance model can effectively help users learn. Furthermore, it can adjust the teaching plan for the user's next corresponding movement based on the user's learning progress, so that users with different learning abilities can learn effectively. Moreover, by adaptively adjusting the difficulty of the VR teaching movements performed by the VR limb guidance model, it can avoid injuries to limbs and joints caused by directly using standard movements that are too difficult for the user. Thus, while ensuring teaching quality, it can improve the user's learning enthusiasm and learning ability through gradual adjustment. Attached Figure Description
[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.
[0017] In the attached diagram:
[0018] Figure 1 A structural block diagram of a VR-based virtual classroom teaching system provided in an embodiment of the present invention;
[0019] Figure 2 The diagram shows a flowchart of a VR-based virtual classroom teaching method provided in an embodiment of the present invention.
[0020] The attached figures are labeled as follows:
[0021] Acquisition unit 111; First identification unit 112; Execution unit 113; Second identification unit 114; Comparison unit 115; Generation unit 116. Detailed Implementation
[0022] The following specific examples illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0023] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of the present invention. The drawings only show the components related to the present invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.
[0024] In the following description, numerous details are explored to provide a more thorough explanation of embodiments of the invention. However, it will be apparent to those skilled in the art that embodiments of the invention may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring embodiments of the invention.
[0025] Please see Figure 1This invention provides a teaching system based on a VR virtual classroom, comprising: an acquisition unit 111 for acquiring the user's limb node coordinates; a first recognition unit 112 for acquiring VR teaching actions corresponding to the VR limb guidance model based on the limb node coordinates, the VR limb guidance model, and the action choreography; an execution unit 113 for executing VR teaching actions through the VR limb guidance model to provide teaching guidance; a second recognition unit 114 for acquiring the actual action formed by the limb node coordinates based on changes in the limb node coordinates during the VR teaching action teaching process; a comparison unit 115 for comparing the actual action with the VR teaching action and acquiring a comparison result; and a generation unit 116 for generating the next teaching plan corresponding to the action choreography based on the comparison result.
[0026] When using the teaching system of this invention to teach postures and movements, it can be used for example, dance instruction, martial arts instruction, or other types of human postures and movements. Specifically, during teaching, the acquisition unit 111 can acquire the coordinates of various limb nodes on the user's body. Then, the first recognition module 112 uses a pre-set VR limb guidance model and movement choreography to generate VR teaching movements for the VR limb guidance model to execute. Then, the execution unit 113 executes the VR limb guidance model sequentially according to the VR teaching movements, thereby forming teaching movements corresponding to the limb node coordinates, which can be used by the user to learn while watching using VR headsets or other VR tools. At the same time, the second recognition unit 114 will also generate corresponding actual movements based on the real-time changes in the limb node coordinates during the VR teaching process. Furthermore, the comparison unit 115 compares the actual actions with the VR teaching actions to determine the gap between the current user's actual actions and the VR teaching actions. This allows for adaptive adjustment of the difficulty of the VR limb guidance model when performing VR teaching actions, avoiding injuries to limbs and joints caused by directly using standard actions that are too difficult for the user. Under the premise of ensuring teaching quality, the user's learning enthusiasm and learning ability can be improved through gradual adjustment.
[0027] The VR-based virtual classroom teaching system of the present invention may further include a model building subunit; the model building subunit includes: a monitoring module, used to monitor the coordinates of the user's limb nodes through a sensor module; a coordinate configuration module, used to use the coordinates of the limb nodes corresponding to the preset position as the model calibration coordinates when the limb nodes are in the preset position; and a model adjustment module, used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain the VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting the limb proportions.
[0028] Before using the teaching system of this invention for instruction, the VR basic limb guidance model can be readjusted using the model construction sub-unit. This allows for adaptation to different user groups based on the same limb node positions for different groups. Specifically, the monitoring module first acquires sensor-uploaded data to monitor the coordinates of each limb node of the user. Alternatively, a camera can be used to capture images of the user's movements, and then the coordinates of each limb node in the image can be determined. The user can then place each limb node at a preset position, and the coordinate configuration module obtains the coordinates of the limb nodes in the preset position as model calibration coordinates. This preset position can be the coordinates of each limb node in an upright position, or any other easily set position. Then, the model adjustment module, based on the model calibration coordinates, adjusts the VR basic limb guidance model according to the set limb proportions to update the VR limb guidance model. In this way, the limb length, width, and other proportions of the VR basic limb guidance model can be adjusted to correspond to the user's actual situation. For example, when the shoulder and wrist coordinates of a person in an upright position are detected, the distance between the shoulder and wrist nodes in the VR basic limb guidance model can be adjusted accordingly. By analogy, the limb proportions of the VR basic limb guidance model can be adjusted to correspond to the user, thereby obtaining a VR limb guidance model to match the user's teaching actions. This allows for precise determination of whether the user can meet the standard requirements when performing actions at each limb node during learning.
[0029] In the VR-based virtual classroom teaching system of the present invention, the first recognition unit 112 includes: an action recognition subunit, used to obtain the user action speed and user action trend of the corresponding limb node based on the change of limb node coordinates; a speed calculation subunit, used to obtain the model action speed corresponding to the VR limb guidance model based on the user action speed and action choreography; a trend calculation subunit, used to obtain the model action trend corresponding to the VR limb guidance model based on the user action trend and action choreography; and an action adjustment subunit, used to adjust the basic model action speed and basic model action trend for action simulation teaching through the VR limb guidance model based on the model action speed and model action trend, and obtain the VR teaching action corresponding to the VR limb guidance model; wherein, the VR teaching action corresponding to the VR limb guidance model is a pre-demonstration of the actual action.
[0030] When using the first recognition unit 112 to recognize the VR teaching actions required by the VR limb guidance model, the action recognition subunit can first determine the user's action speed and trend of the corresponding limb node based on the real-time changes in limb node coordinates. For example, the amount of movement of each limb node per unit time can be determined as the user's action speed; alternatively, the linearity of the current limb node can be obtained using the least squares method based on the current limb node coordinates and the limb node coordinates at adjacent times as the user's action trend; of course, other methods can also be used to obtain the user's action trend.
[0031] Furthermore, the speed calculation subunit includes: a speed query module, used to obtain the basic model action speed corresponding to the VR limb guidance model based on the action choreography; a speed comparison module, used to compare the user's action speed and the basic model action speed to obtain the difference speed; an amplification calculation module, used to obtain the speed amplification based on the difference speed and the action proficiency parameter; and a speed conversion module, used to obtain the model action speed corresponding to the VR limb guidance model based on the difference speed and the speed amplification.
[0032] When the speed calculation subunit calculates the model movement speed corresponding to the VR limb guidance model, the speed query module can obtain the pre-set basic model movement speed based on the movement choreography. This basic model movement speed corresponds to the minimum movement speed that the VR limb guidance model can execute. Then, the speed comparison module compares the obtained user movement speed with the basic model movement speed to obtain the difference speed between the two, providing a reference for the current user movement speed based on the basic model movement speed. Furthermore, after determining the difference speed, a speed increment can be generated using the current user's movement proficiency parameter to further control the model movement speed corresponding to the VR limb guidance model. This prevents the VR limb guidance model from exceeding the user's movement during teaching, leading to speed mismatch and affecting the teaching effect.
[0033] Specifically, the formula for calculating the motor proficiency parameters is as follows: , Indicates the speed of user actions. Indicates the speed of the basic model's movements. This indicates the speed of action of the baseline model.
[0034] The formula for calculating the model's motion speed is as follows: , Indicates the rate of increase in speed. Based on the motor proficiency parameter The table shows the proficiency parameters for each action. Corresponding to a range of speed increase values, by determining the speed increase. The corresponding speed increase range is used to obtain the corresponding movement proficiency parameters. .
[0035] In addition, the following must also be met: model motion speed Less than or equal to the baseline model's motion speed To ensure the model's movement speed Reaching the baseline model's motion speed If the time is right, it means that the current user's action learning has been completed according to standardization.
[0036] In addition, the trend calculation subunit includes: a segment query module, used to obtain a set of model action trend segments corresponding to the VR limb guidance model based on the action arrangement, the set of model action trend segments including several segments of model action trend arranged in the order of action execution; a segment extraction module, used to extract segments of user action trends to obtain user action trend segments, the user action trend segments being action trend segments composed of the user's current action and the actions before it; a trend comparison module, used to compare the user action trend segments with the current model action trend segments; a first output module, used to, when the difference between the user action trend segment and the current model action trend segment is less than a set value, use the current model action trend segment and the subsequent model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model; and a second output module, used to, when the difference between the user action trend segment and the current model action trend segment is greater than a set value, find the model action trend segment with the smallest difference from the user action trend, and use the model action trend segment with the smallest difference from the user action trend and the subsequent model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model.
[0037] When the trend calculation subunit calculates the model action trend corresponding to the VR limb guidance model, the segment query module can use action choreography to find the corresponding model action trend segment set. Furthermore, in the model action trend segment set, each model action trend segment is arranged according to the execution order of the actions. When the user performs an action, the segmentation module extracts the current action and the actions preceding it to form the corresponding action trend segment. Then, the trend comparison module compares the user's action trend segment with the current model action trend segment. If the difference is less than a set value, the current model action trend segment and the subsequent model action trend segments arranged in the execution order are selected as the model action trend corresponding to the VR limb guidance model. If the difference is greater than the set value, it indicates that the user may be performing other actions. Therefore, it is necessary to further find the model action trend segment with the smallest difference from the user's action trend, and select this segment, along with the subsequent model action trend segments arranged in the execution order, as the model action trend corresponding to the VR limb guidance model for execution.
[0038] The formula for calculating the difference between the user action trend segment and the current model action trend segment is as follows: ,in, Represented as the coordinates of each point in the user action trend segment. Represented as the coordinates of each point in the current model action trend segment. This indicates the number of points selected in the user action trend segment / the current model action trend segment.
[0039] In the VR-based virtual classroom teaching system of the present invention, the comparison unit 115 includes: a curve generation subunit, used to obtain the actual action curve based on the actual action; a curve comparison subunit, used to compare the actual action curve with the teaching action curve of the VR teaching action to obtain the action difficulty; a completion calculation subunit, used to calculate the completion degree of the action difficulty based on the actual action curve and the teaching action curve of the VR teaching action to obtain the difficulty completion degree; and a result output subunit, used to use the action difficulty and the difficulty completion degree as the comparison result.
[0040] When comparing actual actions with VR teaching actions, the comparison unit 115 uses a curve generation subunit to draw an actual action curve based on the user's actual actions while following the VR teaching actions. Then, the curve comparison subunit compares the actual action curve with the teaching action curve of the VR teaching actions to determine the user's current action completion status, thereby identifying the difficulties the user faces. Simultaneously, the completion calculation subunit calculates the completion rate of each action difficulty to obtain the difficulty completion score. Finally, the result output subunit sends the action difficulty and difficulty completion score as comparison results to the generation unit 116. This allows the generation unit 116 to use the action difficulty and difficulty completion score to generate a teaching plan for the next lesson, ensuring that the user's learning improves with each session.
[0041] Furthermore, the completion calculation subunit includes: a vertex lookup module, used to find the actual trajectory vertex of the actual action curve corresponding to the action difficulty and the target trajectory vertex of the teaching action curve; a first index calculation module, used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain a first difference index; a second index calculation module, used to compare the curve differences between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex to obtain a second difference index; a third index calculation module, used to compare the overlap between the first normal of the actual trajectory vertex on the actual action curve and the second normal of the target trajectory vertex on the teaching action curve to obtain a third difference index; and a comprehensive calculation module, used to obtain the completion degree of the difficulty based on the first difference index, the second difference index, and the third difference index.
[0042] When calculating the completion degree of the difficult points in the completion degree calculation subunit, the completion degree of the difficult points is mainly affected by the distance between the actual trajectory vertex and the target trajectory vertex, the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex, and the degree of coincidence between the first normal of the actual trajectory vertex on the actual action curve and the second normal of the target trajectory vertex on the teaching action curve. Therefore, the completion degree of the difficult points under the comprehensive index can be determined by calculating the corresponding first difference index, second difference index and third difference index, and then by using the comprehensive calculation module.
[0043] Specifically, the formula for calculating the first difference index can be expressed as follows: The actual trajectory vertex is denoted as The vertex of the target trajectory is denoted as , This represents the first weighting factor.
[0044] When calculating the second difference index, the formula for calculating the second difference index can be expressed as follows: , This represents the second weighting factor. This represents the area of the actual motion curve segment corresponding to the vertex of the actual trajectory. This represents the area of the teaching action curve segment corresponding to the vertex of the target trajectory.
[0045] When calculating the third difference index, the formula for calculating the third difference index can be expressed as follows: , Indicates the third weighting factor. This represents the slope of the first normal line corresponding to the actual trajectory vertex on the actual motion curve. This represents the slope of the second normal line corresponding to the vertex of the target trajectory on the teaching action curve.
[0046] Based on the first, second, and third difference indicators obtained from the mobile phone calculation, the completion rate of the difficult points can be further calculated. .
[0047] In addition, the comparison results mainly include the difficulty of the movements and the degree of completion of those difficulties. After obtaining the comparison results, the next teaching plan for the user can be determined based on these results, thus ensuring that each teaching plan can be adaptively adjusted according to the user's performance.
[0048] In the VR virtual classroom-based teaching system of the present invention, the generation unit 116 includes: a completion comparison subunit, used to compare the completion degree of each action difficulty in the current teaching plan with the historical completion degree of each action difficulty in the set of action difficulties corresponding to previous teaching plans; a first generation subunit, used to obtain a first difficulty completion degree increment based on the average difficulty completion degree corresponding to the stable trend when the completion degree of the current difficulty is in line with the historical difficulty completion degree under a set number of teaching plans, so as to generate the next teaching plan corresponding to the action arrangement based on the first difficulty completion degree increment; a second generation subunit. The first sub-unit is used to generate a second teaching plan for the next activity choreography when the completion rate of the current difficulty level shows an upward trend compared to the historical completion rate of the difficulties under the set number of teaching plans. The second sub-unit is used to generate a third teaching plan for the next activity choreography when the completion rate of the current difficulty level shows a downward trend compared to the historical completion rate of the difficulties under the set number of teaching plans. The third sub-unit is used to decompose the teaching action curve corresponding to the activity difficulty, obtain the decomposed actions, and generate a third teaching plan for the next activity choreography based on the completion rate of the current difficulty level and the decomposed actions.
[0049] In the process of generating the next teaching plan for the choreography based on the difficulty and completion rate of the movements, the generation unit 116 can compare the completion rate of each movement difficulty with the historical completion rate of previous difficulties through the completion rate comparison subunit. This allows it to determine whether the user's movements have improved. If the completion rates show a stable trend during the comparison, it indicates that the difficulty needs to be increased for the user. Then, based on the average completion rate corresponding to the stable trend, a first difficulty completion rate increment can be generated, and the next teaching plan for the choreography can be obtained through this increment. Specifically, after obtaining the average difficulty completion rate, the difficulty can be appropriately increased according to a preset ratio to ensure that the user can continue to improve and achieve the goal of standard movements. Conversely, if the comparison shows an upward trend, it indicates that the user's completion rate can be significantly improved. Therefore, in the next lesson, the difficulty of the VR body guidance model performing VR teaching movements can be increased to meet the learning progress of users with different talents. Finally, when comparing, if there is a downward trend, it means that the current action is relatively difficult for the user. In this case, in the next teaching plan, each VR teaching action performed by the VR body guidance model needs to be further decomposed into different degrees according to the degree of the downward trend, so as to ensure that even users with poor foundation can learn effectively.
[0050] The second generation subunit includes: an ascent calculation module, used to obtain the ascent of the difficulty completion degree based on the difference in completion degree between each two adjacent difficulty completion degrees in the current difficulty completion degree and the historical difficulty completion degree; an adjustment calculation module, used to obtain the value-added adjustment degree based on the current difficulty completion degree; a value-added calculation module, used to adjust the ascent of the difficulty completion degree through the value-added adjustment degree to obtain the value-added of the second difficulty completion degree; and a plan generation module, used to generate the next teaching plan corresponding to the action choreography based on the value-added of the second difficulty completion degree.
[0051] When the second generation subunit uses the upward trend to generate the next teaching plan corresponding to the choreography, it can use the rise rate calculation module to calculate the difference in completion rate between the current and historical difficulty completion rates, thereby determining the user's level of improvement in completing the action, i.e., the rise rate of difficulty completion. Simultaneously, the adjustment rate calculation module can determine the corresponding value-added adjustment rate based on the current difficulty completion rate, which can be obtained by looking up a table based on the difficulty completion rate. After obtaining the value-added adjustment rate, the value-added calculation module can further adjust the rise rate of difficulty completion to obtain a second value-added to difficulty completion. Then, the plan generation module uses the calculated second value-added to difficulty completion to generate the next teaching plan corresponding to the choreography, to determine whether the user's learning process can be further accelerated.
[0052] Specifically, when calculating the incremental improvement in the completion rate of the second difficulty, the formula for calculating the incremental improvement in the completion rate of the second difficulty can be: ,in, Indicates the degree of improvement in the completion rate of the difficult points. This indicates the completion rate of the challenging part. This indicates the adjustment factor.
[0053] Please refer to 2. This invention also provides a teaching method based on a VR virtual classroom, including:
[0054] Step S10: Obtain the coordinates of the user's limb nodes through the acquisition unit;
[0055] Step S20: The first recognition unit obtains the VR teaching actions corresponding to the VR limb guidance model based on the limb node coordinates, VR limb guidance model and action choreography;
[0056] Step S30: The instructional guidance is provided by executing VR teaching actions through the VR body guidance model via the execution unit;
[0057] Step S40: During the VR teaching process, the second recognition unit obtains the actual movement formed by the limb node coordinates based on the changes in limb node coordinates.
[0058] Step S50: Compare the actual actions with the VR teaching actions using the comparison unit to obtain the comparison results;
[0059] Step S60: Based on the comparison results, generate the next teaching plan corresponding to the action choreography by generating the unit.
[0060] In summary, the VR virtual classroom-based teaching system and method disclosed in this invention, through the acquisition of coordinate data of the user's limb nodes, enables interactive learning between the user's actual movements and the VR teaching movements of the VR limb guidance model. This ensures that the VR teaching movements of the VR limb guidance model effectively assist the user's learning. Furthermore, it can adjust the teaching plan for the next time corresponding to the same movement based on the user's learning progress, thus enabling users with different learning abilities to learn effectively. Moreover, by adaptively adjusting the difficulty of the VR teaching movements performed by the VR limb guidance model, it avoids injuries to limbs and joints caused by directly using standard movements that are too difficult for the user. Therefore, while ensuring teaching quality, it can gradually improve the user's learning motivation and ability through adjustments. Thus, this invention effectively overcomes the various shortcomings of the prior art and has high industrial application value.
[0061] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in the present invention should still be covered by the claims of the present invention.
Claims
1. A teaching system based on VR virtual classroom, characterized in that, include: The acquisition unit is used to acquire the coordinates of the user's limb nodes; The first recognition unit is used to obtain the VR teaching action corresponding to the VR limb guidance model based on the limb node coordinates, the VR limb guidance model and the action choreography; The execution unit is used to perform the VR teaching actions through the VR body guidance model to provide teaching guidance; The second recognition unit is used to obtain the actual action formed by the limb node coordinates based on the changes in the limb node coordinates during the VR teaching action teaching process; The comparison unit is used to compare the actual action with the VR teaching action and obtain the comparison result; as well as A generation unit is used to generate the next teaching plan corresponding to the action choreography based on the comparison results. The comparison unit includes: A curve generation subunit is used to obtain the actual action curve based on the actual action. The curve comparison subunit is used to compare the actual action curve with the teaching action curve of the VR teaching action to identify the difficulty of the action; The completion calculation subunit is used to calculate the completion degree of the difficulty points of the action based on the actual action curve and the teaching action curve of the VR teaching action, and to obtain the completion degree of the difficulty points; and The result output subunit is used to take the difficulty of the action and the degree of completion of the difficulty as the comparison result; The completion calculation subunit includes: The vertex lookup module is used to find the actual trajectory vertex of the actual action curve corresponding to the action difficulty and the target trajectory vertex of the teaching action curve; The first index calculation module is used to calculate the distance between the actual trajectory vertex and the target trajectory vertex to obtain the first difference index. The second index calculation module is used to compare the curve difference between the actual action curve segment corresponding to the actual trajectory vertex and the teaching action curve segment corresponding to the target trajectory vertex to obtain the second difference index. The third index calculation module is used to compare the overlap between the first normal of the actual trajectory vertex on the actual motion curve and the second normal of the target trajectory vertex on the teaching motion curve to obtain a third difference index; and The comprehensive calculation module is used to obtain the completion rate of the difficult points based on the first difference index, the second difference index and the third difference index.
2. The teaching system based on VR virtual classroom according to claim 1, characterized in that, It also includes model building subunits; The model construction subunit includes: The monitoring module is used to monitor the coordinates of the user's limb nodes through the sensor module; A coordinate configuration module is used to use the coordinates of the limb node corresponding to a preset position as the model calibration coordinates when the limb node is in a preset position; and The model adjustment module is used to adjust the limb proportions of the VR basic limb guidance model according to the model calibration coordinates to obtain the VR limb guidance model, wherein the VR basic limb guidance model is constructed by setting limb proportions.
3. The teaching system based on VR virtual classroom according to claim 1, characterized in that, The first identification unit includes: The action recognition subunit is used to obtain the user's action speed and user action trend of the corresponding limb node based on the changes in the coordinates of the limb node. The speed calculation subunit is used to obtain the model movement speed corresponding to the VR limb guidance model based on the user's movement speed and the movement arrangement. A trend calculation subunit is used to obtain the model action trend corresponding to the VR limb guidance model based on the user action trend and the action choreography; and The motion adjustment subunit is used to adjust the basic model motion speed and basic model motion trend for motion simulation teaching through the VR limb guidance model according to the model motion speed and the model motion trend, and to obtain the VR teaching motion corresponding to the VR limb guidance model. The VR teaching actions corresponding to the VR limb guidance model are advance demonstrations of the actual actions.
4. The teaching system based on VR virtual classroom according to claim 3, characterized in that, The velocity calculation subunit includes: The speed query module is used to obtain the basic model movement speed corresponding to the VR limb guidance model based on the movement arrangement. The speed comparison module is used to compare the user's action speed with the base model's action speed to obtain the difference speed. An amplification calculation module is used to obtain the speed amplification based on the difference speed and movement proficiency parameters; and The speed conversion module is used to obtain the model movement speed corresponding to the VR limb guidance model based on the difference speed and the speed increase.
5. The teaching system based on VR virtual classroom according to claim 3, characterized in that, The trend calculation subunit includes: The segment query module is used to obtain a set of model action trend segments corresponding to the VR limb guidance model based on the action arrangement. The set of model action trend segments includes several segments of model action trend segments arranged in the order of action execution. The segmentation module is used to segment the user action trend to obtain a user action trend segment, wherein the user action trend segment is an action trend segment composed of the user's current action and the actions before it. The trend comparison module is used to compare the user action trend segment with the current model action trend segment. The first output module is configured to, when the difference between the user's action trend segment and the current model action trend segment is less than a set value, use the current model action trend segment and the subsequent model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model; and The second output module is used to find the model action trend segment with the smallest difference from the user action trend segment when the difference between the user action trend segment and the current model action trend segment is greater than a set value, and to take the model action trend segment with the smallest difference from the user action trend segment and the model action trend segments arranged in the order of action execution as the model action trend corresponding to the VR limb guidance model.
6. The teaching system based on VR virtual classroom according to claim 1, characterized in that, The comparison results include the difficulty of the action and the degree of completion of the difficulty; The generation unit includes: The completion comparison sub-unit is used to compare the completion rate of each movement difficulty in this teaching plan with the historical completion rate of each movement difficulty in the set of movement difficulties corresponding to previous teaching plans. The first generation subunit is used to obtain the first difficulty completion value increment based on the average difficulty completion value corresponding to the stable trend when the completion degree of the current difficulty is stable compared with the historical difficulty completion degree under the set number of teaching plans. Based on the first difficulty completion value increment, the next teaching plan corresponding to the action choreography is generated. The second generation subunit is used to, when the completion rate of the current difficulty shows an upward trend compared to the historical completion rate of the set number of teaching plans, obtain a second difficulty completion rate increment based on the increase in difficulty completion rate corresponding to the upward trend, and generate the next teaching plan corresponding to the movement choreography based on the second difficulty completion rate increment; and The third generation subunit is used to decompose the teaching action curve corresponding to the action difficulty when the completion rate of the current difficulty and the completion rate of the historical difficulty under the set number of teaching plans show a downward trend, obtain the decomposed actions, and generate the next teaching plan corresponding to the action arrangement based on the completion rate of the current difficulty and the decomposed actions.
7. The teaching system based on VR virtual classroom according to claim 6, characterized in that, The second generation subunit includes: The rise rate calculation module is used to obtain the rise rate of difficulty completion based on the difference in completion rate between each two adjacent difficulty completion rates in the current difficulty completion rate and the historical difficulty completion rate. The adjustment degree calculation module is used to obtain the added value adjustment degree based on the completion degree of the current difficulty. The value-added calculation module is used to adjust the increase in the completion degree of the difficulty through the value-added adjustment degree, and obtain the value-added of the completion degree of the second difficulty; and The plan generation module is used to generate the next teaching plan corresponding to the action choreography based on the increase in the completion rate of the second difficulty.
8. A teaching method using the VR virtual classroom-based teaching system according to any one of claims 1-7, characterized in that, include: The coordinates of the user's limb nodes are obtained through the acquisition unit; The first recognition unit obtains the VR teaching actions corresponding to the VR limb guidance model based on the limb node coordinates, the VR limb guidance model, and the action choreography. The execution unit performs VR teaching actions through the VR body guidance model to provide teaching guidance. During the VR teaching process, the second recognition unit obtains the actual movement formed by the limb node coordinates based on the changes in the limb node coordinates. The comparison unit compares the actual actions with the VR teaching actions to obtain the comparison results; Based on the comparison results, the generation unit generates the next teaching plan corresponding to the choreography.