Gymnastic action remote teaching system control method, system, equipment and medium

Abstract

The invention relates to the technical field of remote teaching, and particularly provides a gymnastic action remote teaching system control method, system and equipment and a medium. The method comprises the steps that a teacher-side host collects teacher-side human kinematics information and transmits the teacher-side human kinematics information to a wearable processor; the wearable processor processes the kinematics information, generates an action label and standard three-dimensional data, transmits the action label to the student-side host, and transmits the standard three-dimensional data to the student-side host and the teacher-side wearable device; the student-side host generates personalized three-dimensional data and transmits the personalized three-dimensional data to the teacher-side wearable device; the teacher-side wearable device receives the standard three-dimensional data, generates a three-dimensional projection and projects the three-dimensional projection into a teacher-side motion space; and the student-side wearable device receives the standard three-dimensional data and the personalized three-dimensional data and generates a virtual training space. By means of the method, accurate transfer of the gymnastics teaching process is achieved, accurate remote gymnastics action teaching is achieved, and the learning enthusiasm of students is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of remote teaching, and specifically provides a gymnastics movement remote teaching system control method, system, equipment and medium. Background Art

[0002] In physical education, the learning of sports skills is mainly carried out through action demonstration, action guidance and practical exercises. At present, the on-site teaching mode is mainly adopted, with teachers demonstrating on-site and students practicing on-site. For non-contact sports skills or actions, such as water sports or ice and snow projects, since physical exercise is required in sports venues and various fitness equipment, action demonstrations and action guidance will be carried out in corresponding sports venues if weather conditions or venue and equipment conditions permit. However, if there are weather reasons or venue restrictions, physical education teaching will be moved indoors.

[0003] Although existing physical education teaching can help students learn sports skills, it has the following defects: First, existing physical education teaching needs to be conducted on-site. For some specific sports skills, it is difficult to find a suitable venue for practical training. For example, skiing training needs to be conducted at a ski resort. For students, sports practical training has great limitations; secondly, it is difficult to achieve standard demonstration of sports movements in existing physical education teaching. When students face different sports equipment, it is difficult to grasp sports skills or movement essentials. Even if teachers conduct standard demonstrations for specific sports skills, it is difficult to learn the corresponding sports skills in a standard manner due to different physical conditions or learning abilities of students; moreover, even if demonstrations and explanations are conducted based on sports equipment movements in physical education classes, it is difficult for students to master the corresponding sports skills if they do not have time to train after class.

[0004] In the process of physical education teaching, how to rationally utilize venues and equipment facilities, improve teaching efficiency, and teach students in accordance with their aptitude is of great significance to the further promotion of sports.

[0005] In addition, for outdoor learning of sports skills and teaching of sports projects in remote or high-risk areas, how to use technological means to achieve remote interactive teaching, and overcome the limitations of sports project teaching conditions in remote or high-risk areas to help students master and learn relevant sports project skills, has far-reaching significance for the promotion of sports. Summary of the invention

[0006] The invention provides a gymnastics movement remote teaching system control method, system, equipment and medium, which are used to solve the problem of inaccurate gymnastics movement retelling in the communication process of the existing remote teaching technology.

[0007] In a first aspect, the present invention provides a control method for a gymnastics movement remote teaching system, comprising: a teacher-side host collects teacher-side human kinematic information and transmits it to a wearable processor; the wearable processor processes the teacher-side human kinematic information and generates action labels and standard three-dimensional data, transmits the action labels to a student-side host, and transmits the standard three-dimensional data to the student-side host and a teacher-side wearable device; the student-side host generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device; the teacher-side wearable device receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into a teacher-side motion space; the student-side wearable device receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0008] Optionally, the student-side host generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device, including: The student-side host processes the physiological signals, inertial data, and surface data fed back by the student's movements, thereby generating personalized three-dimensional data; The personalized three-dimensional data is transmitted to the teacher's wearable device to guide the student's exercise process.

[0009] Optionally, the student-side host processes physiological signals, inertial data, and surface data fed back by the student's movements to generate personalized three-dimensional data, including: Analyze the physiological signals of students' movement feedback, identify students' muscle capacity information, and generate standard three-dimensional postures as personalized three-dimensional data; Analyze the inertial data of students' movement feedback, extract the movement phases of different limbs, and generate personalized 3D postures as personalized 3D data based on the students' 3D morphology; Analyze the surface data of students' movement feedback, extract the relative relationship between different limb parts, and construct a three-dimensional template of students' movements as personalized three-dimensional data.

[0010] Optionally, the standard three-dimensional posture refers to a standard three-dimensional posture display, including the movement process of the body and limbs; the personalized three-dimensional posture includes different parameters of the student's training process.

[0011] Optionally, the method further comprises: The student-side host receives the action labels generated by the action analysis algorithm module, generates an action practice module, and implements the action practice function.

[0012] Optionally, the student-side host receives the action tag, generates an action practice module, and implements the action practice function, including: Generate an action practice module based on the current action mode of the student host; Using the action practice module, physiological signals, inertial data and surface information are received, and the data is calculated according to the preset algorithm to generate a label that matches the current action; The action label corresponding to the current action is analyzed and compared with the generated action matching label through the pattern matching algorithm, and the comparison result is displayed to the corresponding students to realize the action practice function.

[0013] Optionally, the pattern matching algorithm adopts a cosine similarity model, including: Establish a pattern space and define action patterns and labels based on human action characteristics; The feature extraction algorithm is used to extract features of the preset actions, and the neural network algorithm is used to train the extracted feature vectors to build a pattern classification model; Train preset actions through deep learning algorithms to build pattern generation models; When the action is executed, the neural network feature vector is generated, and the trained neural network model is calculated, and the results are extracted and fed back from the action pattern library; Calculate the cosine similarity between the feedback result and the feature vector to generate a result set; The result set is calculated through a pattern classification model to generate a matching result.

[0014] In a second aspect, the present application provides a gymnastics movement remote teaching system, including: a teacher-side host, a wearable processor, a student-side host, a teacher-side wearable device, and a student-side wearable device; the teacher-side host, the wearable processor, and the student-side host are respectively connected to the teacher-side wearable device and the student-side wearable device; The teacher-side host is used to collect the teacher-side human body kinematics information and transmit it to the wearable processor; The wearable processor is used to process human kinematics information and generate motion tags and standard three-dimensional data, transmit the motion tags to the student-side host, and transmit the standard three-dimensional data to the student-side host and the teacher-side wearable device; The student-side host is used to generate personalized three-dimensional data and transmit the personalized three-dimensional data to the teacher-side wearable device; The teacher-side wearable device is used to receive standard three-dimensional data, generate a three-dimensional projection, and project the generated three-dimensional projection into the teacher-side motion space; The student-side wearable device is used to receive standard three-dimensional data and personalized three-dimensional data, generate a virtual training space, and generate a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0015] In a third aspect, the present invention further provides an electronic device comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements any of the above-mentioned methods for controlling a remote teaching system for gymnastics movements.

[0016] In a fourth aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the gymnastics movement remote teaching system control method described in any one of the above items is implemented.

[0017] The control method of the gymnastics movement remote teaching system provided by the present invention, first, collects the human body kinematic information of the teacher side through the teacher side host, and transmits it to the wearable processor; the wearable processor processes the human body kinematic information of the teacher side and generates action tags and standard three-dimensional data, transmits the action tags to the student side host, and transmits the standard three-dimensional data to the student side host and the teacher side wearable device; secondly, the student side host generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher side wearable device; the teacher side wearable device receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher side motion space; finally, the student side wearable device receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space. It is realized that during the practical training process of physical education class, the teacher can display the real-time three-dimensional posture of limb movement to the student side through the remote communication terminal. Students can refer to the teacher's motion posture for training, and improve the practical value and accuracy of remote teaching. This method realizes accurate remote sports movement teaching.

[0018] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 It is a flow chart of a gymnastics movement remote teaching system control method provided by the present invention; Figure 2 is a flow chart of a method for generating personalized three-dimensional data provided by an embodiment of the present invention; Figure 3is a schematic diagram of a flow chart of a pattern matching algorithm provided by an embodiment of the present invention; Figure 4 It is a structural schematic diagram of the gymnastics movement remote teaching system provided by the present invention; Figure 5 It is a schematic diagram of the physical structure of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] The purpose of the present invention is to provide a remote teaching system for gymnastics movements, which completes the remote modeling of teachers and students by establishing a three-dimensional model of the human body and using the spatial coordinates of key points, and automatically generates them according to height, weight and joint point positions, thereby reducing the trouble of manual input, improving the fun of teaching demonstrations and interactions, and enhancing the user experience.

[0023] Combine the following Figures 1 to 5 The embodiments shown describe the technical solution of the present invention: like Figure 1 As shown, the embodiment of the present invention provides a gymnastics movement remote teaching system control method, which may include the following steps: S110, the teacher-side host 401 collects the teacher-side human body kinematics information and transmits it to the wearable processor 402.

[0024] Optionally, the teacher-side wearable processor 402 includes: The motion acquisition unit is used to receive the teacher's human body kinematics information and the virtual projection data of the teaching scene; A motion analysis algorithm unit, used for processing human kinematics information and generating motion labels and standard three-dimensional data, and transmitting them to a data transmission unit; The data transmission unit is used to transmit the action tag to the student-side host 403 and transmit the standard three-dimensional data to the student-side host 403 and the teacher-side wearable device 404.

[0025] Among them, the human body kinematic information collected by the motion acquisition unit on the teacher side includes: inertial data, surface data, and physiological signals.

[0026] The motion analysis algorithm processes the teacher's human kinematic information including: Action recognition algorithm module, used to analyze and process data, extract and classify different actions, and then generate action labels; The motion analysis algorithm module is used to process the data and generate standard three-dimensional data.

[0027] Preferably, the motion analysis algorithm module adopts a motion analysis algorithm (gesture estimation module, motion classification module, gesture generation module) to respectively perform data input and output control, motion recognition, and gesture generation; The posture estimation module is used to analyze and process the data and store the analyzed and processed data; Action classification module, used to analyze and process postures and generate action labels through training; The posture generation module is used to integrate different action postures and generate standard three-dimensional data.

[0028] Preferably, the teacher-side host 401 and the wearable processor 402 use wireless communication methods, including USB and Bluetooth; The wearable processor 402 communicates with the student-side host 403 and the teacher-side wearable device 404 using wireless communication methods, including USB and Bluetooth.

[0029] S120, the wearable processor 402 processes the human body kinematics information on the teacher side and generates motion labels and standard three-dimensional data, transmits the motion labels to the student side host 403, and transmits the standard three-dimensional data to the student side host 403 and the teacher side wearable device 404.

[0030] The transmitting of the action label to the student-side host 403 may include: the student-side host 403 receives the action label generated by the action analysis algorithm module, generates an action practice module, and implements the action practice function.

[0031] Furthermore, the student host 403 receives the action tag and generates an action practice module, and the action practice function may include: Generate an action practice module for the current action mode of the student host 403; Using the action practice module, physiological signals, inertial data and surface information are received, and the data is calculated according to the preset algorithm to generate a label that matches the current action; The action label corresponding to the current action is analyzed and compared with the generated action matching label through the pattern matching algorithm, and the comparison result is displayed to the corresponding students to realize the action practice function.

[0032] Among them, Figure 2 As shown, the pattern matching algorithm uses a cosine similarity model and may include: S121, establish a pattern space, and define action patterns and labels according to human action characteristics; S122, extracting features of the preset action by using a feature extraction algorithm, and training the extracted feature vectors by using a neural network algorithm to construct a pattern classification model; S123, training the preset actions through a deep learning algorithm to build a pattern generation model; S124, when the action is executed, a neural network feature vector is generated, and the trained neural network model is calculated, and the result is extracted and fed back from the action pattern library; S125, performing cosine similarity calculation on the feedback result and the feature vector to generate a result set; S126. Calculate the result set through the pattern classification model to generate a matching result.

[0033] S130, the student-side host 403 generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device 404.

[0034] Alternatively, if Figure 3 As shown, the above step S130 may include: S131, the student-side host 403 processes the physiological signals, inertial data, and surface data fed back by the student's movements, and then generates personalized three-dimensional data; S132, transmitting the personalized three-dimensional data to the teacher's wearable device 404 to guide the student's exercise process.

[0035] Furthermore, the student-side host 403 processes the physiological signals, inertial data, and surface data fed back by the student's movements, and then generates personalized three-dimensional data, including: Analyze the physiological signals of students' movement feedback, identify students' muscle capacity information, and generate standard three-dimensional postures as personalized three-dimensional data; Analyze the inertial data of students' movement feedback, extract the movement phases of different limbs, and generate personalized 3D postures as personalized 3D data based on the students' 3D morphology; Analyze the surface data of students' movement feedback, extract the relative relationship between different limb parts, and construct a three-dimensional template of students' movements as personalized three-dimensional data.

[0036] Among them, standard three-dimensional posture refers to the standard three-dimensional posture display, including the movement process of the body and limbs; personalized three-dimensional posture includes different parameters of the student training process.

[0037] S140, the teacher-side wearable device 404 receives standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher-side motion space.

[0038] Preferably, the teacher-side wearable device 404 includes: An interactive interface unit, used for interaction and display between the teacher-side wearable device 404 and the teacher-side host 401; An action generation unit, used for receiving the standard three-dimensional data of the teacher-side host 401 and generating a three-dimensional projection, and transmitting the three-dimensional projection to the projection unit; The projection unit is used to project the generated three-dimensional projection into the movement space of the teacher's end to realize the remote display of human body movements.

[0039] S150. The student-side wearable device 405 receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0040] Preferably, the student-side wearable device 405 includes: An interactive interface unit, used for interaction and display between the student-side wearable device 405 and the student-side host 403; A data transmission unit, used for receiving standard three-dimensional action data and personalized three-dimensional data, and transmitting the personalized three-dimensional data to the action generation unit; The action generation unit is used to generate virtual training scenes, standard 3D projections and personalized 3D projections. The student-side wearable device 405 receives data from the teacher-side wearable processor 402 and the student-side host 403, and integrates it with the student's training to generate a 3D virtual scene.

[0041] Among them, the student-side host 403, the teacher-side host 401 and the wearable processor 402 all include a motion analysis algorithm module, which can be implemented using the SVM method in deep learning, or the DBN method, or the CNN method, or the RNN method.

[0042] Specifically, the teacher-side host 401 sends an action instruction to the teacher-side wearable device 404 and the student-side wearable device 405; the teacher-side wearable device 404 and the student-side wearable device 405 collect motion information and human image data of the wearable device according to the received motion instruction, and transmit the collected data to the wear processor 402, and the action instruction includes: action label and action instruction; the wear processor 402 receives the collected data transmitted by the teacher-side wearable device 404 and the student-side wearable device 405, and the data transmitted to the wear processor 402 by the teacher-side wearable device 404 and the student-side wearable device 405 are transmitted to the teacher-side host 401 and the student-side host 403 respectively; the student-side host 403 transmits the received teaching information of the teacher-side host 401 to the wear processor 402 of the student side. The wear processor 402 processes the received data and controls the action of the wearable device. The wearable device worn by the teacher collects the teaching data of the teacher-side host 401, including motion information and teaching images, and transmits the collected teaching data of the teacher-side host 401 to the teacher-side host 401. The wearable device worn by the student collects the motion trajectory data of the student host 403, and transmits the collected motion data of the student host 403 to the student host 403; through the data transmission between the student host 403 and the teacher host 401, the remote transmission of three-dimensional information is realized. The wearable processor 402 sends instructions to the teacher host 401 and the student host 403 to realize the teaching process; the student host transmits the received teaching information of the teacher host to the wearable device at the student end.

[0043] Furthermore, the teaching image of the teacher-side host 401 sent from the teacher-side wearable device 404 is received through the information processing module; the teaching image of the teacher-side wearable device 404 is a real-time transmission process, that is: the information processing module receives the teaching image of the teacher-side host 401 sent from the teacher-side wearable device 404, and the teaching image of the teacher-side host 401 includes images and sounds; the information processing module transmits the received teaching image of the teacher-side host 401 to the student-side host 403; the motion data of the student-side host 403 from the student-side wearable device 405 is received through the video acquisition module; the student-side host 403 receives the motion information and human image data sent by the student-side wearable device 405, and transmits the received motion data to the information processing module, and the motion data includes motion information and human image data.

[0044] The remote transmission of the action standard information is completed in the student-side host 403 and the teacher-side host 401 through the information processing module. The action standard information includes: image information of the teacher-side host 401 and action information of the student-side host 403. The action data information of the student-side wearable device 405 that has been processed is fed back to the teacher-side host 401 through the communication interface module to realize the instruction evaluation feedback of the student side. The instruction evaluation feedback includes: evaluation information and feedback information of the teacher side.

[0045] The gymnastics movement remote teaching system control method provided by the embodiment of the present invention realizes high-precision movement analysis, analyzes different movement modes, and can generate three-dimensional projections of the student end and the teacher end according to different situations of the student end and the teacher end, thereby achieving real-time high-precision movement analysis and human remote movement information collection. Different student data can be collected, and personalized standard movement data can be generated for different students, which can meet the personalized movement postures of different students and achieve high efficiency of remote teaching. At the same time, the present invention also uses wearable flexible devices to collect human movement information, realize three-dimensional display of human movement, and improve the accuracy of remote teaching. When the movement is in progress, the information fed back by the students is processed and fed back to the student end, and the three-dimensional projection is displayed at the same time, which is beneficial for students to improve the efficiency of training.

[0046] like Figure 4 As shown, the embodiment of the present invention also provides a gymnastics movement remote teaching system, including: a teacher-side host 401, a wearable processor 402, a student-side host 403, a teacher-side wearable device 404 and a student-side wearable device 405; The teacher-side host 401, the wearable processor 402, and the student-side host 403 are respectively connected to the teacher-side wearable device 404 and the student-side wearable device 405; The teacher-side host 401 is used to collect the teacher-side human body kinematics information and transmit it to the wearable processor 402; The wearable processor 402 is used to process human kinematic information and generate motion tags and standard three-dimensional data, transmit the motion tags to the student-side host 403, and transmit the standard three-dimensional data to the student-side host 403 and the teacher-side wearable device 404; The student-side host 403 is used to generate personalized three-dimensional data and transmit the personalized three-dimensional data to the teacher-side wearable device 404; The teacher-side wearable device 404 is used to receive standard three-dimensional data, generate a three-dimensional projection, and project the generated three-dimensional projection into the teacher-side motion space; The student-side wearable device 405 is used to receive standard three-dimensional data and personalized three-dimensional data, generate a virtual training space, and generate a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0047] Specifically, the teacher-side host 401 collects the teacher-side human kinematic information, which may specifically include: collecting physiological signals, inertial data and human body surface data of each limb part respectively, and preprocessing each signal to obtain human kinematic information; the human kinematic information includes: teacher-side marking points, teacher-side inertial data, and teacher-side surface data; wherein the teacher-side marking points and teacher-side surface data correspond to the teacher-side limb part marking points respectively, and the teacher-side inertial data is associated with each teacher-side limb part. Among them, the teacher-side limb parts include: head, neck, waist, wrist, knee, hip, and ankle.

[0048] Exemplarily, physiological signals of limb parts include: electromyographic signals, electrocardiographic signals, and electrodermal signals.

[0049] Furthermore, the wearable processor 402 processes the human kinematics information on the teacher side through a motion analysis algorithm, describes the sports movements in text or graphics, and establishes sports movement labels; combines the three-dimensional form of the teacher side to generate a standard three-dimensional human movement, and transmits it to the student side host 403 and the teacher side wearable device 404; Among them, the motion analysis algorithm includes: Human kinematics information processing; Extract action labels based on human kinematics information; Signal analysis is performed on the information of individual limb parts, and the movement stage of the limb part is identified through a pre-trained pattern recognition model.

[0050] Furthermore, the student-side host 403 generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device 404, including: The student-side host 403 processes the physiological signals, inertial data, and surface data fed back by the student's movements to generate personalized three-dimensional data; and transmits the personalized three-dimensional data to the teacher-side wearable device 404 to guide the student's movement process.

[0051] Furthermore, the student-side host 403 processes the physiological signals, inertial data, and surface data fed back by the student's movements, and then generates personalized three-dimensional data including: Analyze the physiological signals of students' movement feedback, identify students' muscle capacity information, and generate standard three-dimensional postures as personalized three-dimensional data; Analyze the inertial data of students' movement feedback, extract the movement phases of different limbs, and generate personalized 3D postures as personalized 3D data based on the students' 3D morphology; Analyze the surface data of students' movement feedback, extract the relative relationship between different limb parts, and construct a three-dimensional template of students' movements as personalized three-dimensional data.

[0052] Specifically, the teacher-side host 401 provides the teacher's classroom teaching content and displays the output images transmitted by the student-side host 403 in real time.

[0053] The content of the classroom teaching includes: the teacher's image, sound and sports information. The teacher-side host 401 receives the sports action information transmitted by the student-side host 403 in real time, and transmits the received information to the teacher-side wearable device 404.

[0054] The sports action information includes: action labels and action tracks. The teacher-side host 401 provides the teaching process for the teacher-side.

[0055] The teaching process provided by the teacher host 401 includes: the output mode and interactive function of the teacher host 401. The output mode of the teacher host 401 is set to display mode. The interactive function of the teacher host 401 includes: evaluating the actions performed by the students and providing feedback on the instructions for different actions.

[0056] Among them, the teacher-side host 401 and the teacher-side wearable device 404 are connected via wire.

[0057] The teacher-side host 401 sends action instructions to the teacher-side wearable device 404 through a wired connection; the teacher-side wearable device 404 sends feedback information to the teacher-side host 401 through a wired connection.

[0058] The student-side host 403 provides student-side training content and receives teaching information from the teacher-side host 401 in real time.

[0059] The student-side host 403 transmits the received information to the student-side wearable device 405 , and the student-side host 403 receives the information sent by the student-side wearable device 405 and transmits the received information to the teacher-side host 401 .

[0060] The teaching process provided by the student host 403 includes: output mode of the student, interactive function, and instruction feedback for different actions. The output mode of the student host 403 includes: image and sound.

[0061] The interactive functions of the student-side host 403 include: feedback of student actions, and the student-side host 403 and the student-side wearable device 405 are connected via a wire.

[0062] Data processing and transmission: The teacher-side host 401, the wearable processor 402, and the student-side host 403 are respectively connected to the teacher-side wearable device 404 and the student-side wearable device 405.

[0063] The teaching images include: a demonstration scene with a human body as the core, a motion space as the environment, and a motion track as a dynamic element. The student-side host 403 and the teacher-side host 401 are both computers.

[0064] The wearable processor 402 includes: a video acquisition module, an information processing module and an interaction module. The video acquisition module pre-processes the data collected by the wearable processor 402, the information processing module completes the input and output information processing and data interaction of the student host 403 and the teacher host 401, and the interaction module provides human-computer interaction services.

[0065] The video acquisition module is powered by the teacher host 401 and the student host 403 through a wired connection. The student host 403 sends action instructions to the video acquisition module through a wired connection; the data processing and transmission transmits the received information to the teacher host 401.

[0066] The teacher-side wearable device 404 includes: a motion sensor and an image acquisition module.

[0067] The motion sensor is used to collect motion signals from the teacher-side wearable device 404 and send the collected signals to the teacher-side host 401.

[0068] The image acquisition module is used to collect image signals from the front end of the teacher-side wearable device 404 and send the collected signals to the teacher-side host 401.

[0069] The teacher-side wearable device 404 is provided with power by the teacher-side host 401 through a wired connection. The teacher-side host 401 sends action instructions to the teacher-side wearable device 404 through a wired connection; the teacher-side wearable device 404 feeds back information to the teacher-side host 401 through a wired connection.

[0070] The student-side wearable device 405 includes: a motion sensor and an image acquisition module.

[0071] The motion sensor is used to collect motion signals from the student-side wearable device 405 and send the collected signals to the student-side host 403.

[0072] The image acquisition module is used to collect image signals from the front end of the student-side wearable device 405 and send the collected signals to the student-side host 403.

[0073] The student-side wearable device 405 is provided with power by the student-side host 403 through a wired connection. The student-side host 403 sends action instructions to the student-side wearable device 405 through a wired connection; the student-side wearable device 405 feeds back information to the student-side host 403 through a wired connection.

[0074] The gymnastics movement remote teaching system provided by the embodiment of the present invention includes: a teacher-side host 401, a wearable processor 402, a student-side host 403, a teacher-side wearable device 404 and a student-side wearable device 405; the teacher-side host 401, the wearable processor 402 and the student-side host 403 are respectively connected to the teacher-side wearable device 404 and the student-side wearable device 405. In the practical training of physical education classes, the three-dimensional information of the teacher side is transmitted to the student side, the accurate retelling of the physical education teaching process is achieved, and the students' accurate grasp of the movement standards is achieved. In addition, the system can combine outdoor sports scenes with indoor teaching, effectively improving students' enthusiasm for learning sports movements. At the same time, under the premise of accurate sports movement standards, students can flexibly adjust the training difficulty according to their own situation and conduct targeted training. Through system feedback, the training results of students can also be evaluated in real time, accurately and visually, which is conducive to the evaluation of sports skills.

[0075] An embodiment of the present invention also provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the gymnastics movement remote teaching system control method provided in the above embodiment is implemented.

[0076] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the gymnastics movement remote teaching system control method provided in the above embodiment is implemented.

[0077] Figure 5 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 5As shown, the electronic device may include: a processor (processor) 510, a communication interface (Communications Interface) 520, a memory (memory) 530 and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540. The processor 510 can call the logic instructions in the memory 530 to execute the gymnastics movement remote teaching system control method, which includes: the teacher-side host 401 collects the teacher-side human kinematic information and transmits it to the wearable processor 402; the wearable processor 402 processes the teacher-side human kinematic information and generates action tags and standard three-dimensional data, transmits the action tags to the student-side host 403, and transmits the standard three-dimensional data to the student-side host 403 and the teacher-side wearable device 404; the student-side host 403 generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device 404; the teacher-side wearable device 404 receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher-side motion space; the student-side wearable device 405 receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0078] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0079] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the gymnastics movement remote teaching system control method provided by the above methods, and the method includes: the teacher-side host 401 collects the teacher-side human kinematic information and transmits it to the wearable processor 402; the wearable processor 402 processes the teacher-side human kinematic information and generates action labels and standard three-dimensional data, transmits the action labels to the student-side host 403, and transmits the standard three-dimensional data to the student-side host 403 and the teacher-side wearable device 404; the student-side host 403 generates personalized three-dimensional data, and transmits the personalized three-dimensional data to the teacher-side wearable device 404; the teacher-side wearable device 404 receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher-side motion space; the student-side wearable device 405 receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0080] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the gymnastics movement remote teaching system control method provided by the above-mentioned methods, the method comprising: a teacher-side host 401 collects human kinematic information on the teacher-side and transmits it to a wearable processor 402; the wearable processor 402 processes the human kinematic information on the teacher-side and generates action labels and standard three-dimensional data, transmits the action labels to a student-side host 403, and transmits the standard three-dimensional data to the student-side host 403 and a teacher-side wearable device 404; the student-side host 403 generates personalized three-dimensional data, and transmits the personalized three-dimensional data to a teacher-side wearable device 404; the teacher-side wearable device 404 receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher-side motion space; the student-side wearable device 405 receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

[0081] The system embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative effort.

[0082] Through the description of the above implementation modes, those skilled in the art can clearly understand that each implementation mode can be implemented by means of software plus a necessary general hardware platform, or of course by hardware. Based on such an understanding, the above technical solution can essentially or in other words be embodied in the form of a software product that contributes to the prior art. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment or some parts of the embodiment.

[0083] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A gymnastics movement remote teaching system control method, characterized in that: include: The teacher host collects the teacher's human body kinematics information and transmits it to the wearable processor; The wearable processor processes the teacher-side human body kinematics information and generates motion tags and standard three-dimensional data, transmits the motion tags to the student-side host, and transmits the standard three-dimensional data to the student-side host and the teacher-side wearable device; The student-side host generates personalized three-dimensional data and transmits the personalized three-dimensional data to the teacher-side wearable device; The teacher-side wearable device receives the standard three-dimensional data, generates a three-dimensional projection, and projects it into the teacher-side motion space; The student-side wearable device receives the standard three-dimensional data and the personalized three-dimensional data, generates a virtual training space, and generates a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

2. The gymnastics movement remote teaching system control method according to claim 1, characterized in that: The student-side host generates personalized three-dimensional data and transmits the personalized three-dimensional data to the teacher-side wearable device, including: The student-side host processes the physiological signals, inertial data, and surface data fed back by the student's movements, thereby generating personalized three-dimensional data; The personalized three-dimensional data is transmitted to the teacher's wearable device to guide the student's exercise process.

3. The gymnastics movement remote teaching system control method according to claim 2, characterized in that: The student-side host processes the physiological signals, inertial data, and surface data fed back by the student's movements, and then generates personalized three-dimensional data, including: Analyze the physiological signals of students' movement feedback, identify students' muscle capacity information, and generate standard three-dimensional postures as personalized three-dimensional data; Analyze the inertial data of students' movement feedback, extract the movement phases of different limbs, and generate personalized 3D postures as personalized 3D data based on the students' 3D morphology; Analyze the surface data of students' movement feedback, extract the relative relationship between different limb parts, and construct a three-dimensional template of students' movements as personalized three-dimensional data.

4. The gymnastics movement remote teaching system control method according to claim 3, characterized in that: The standard three-dimensional posture refers to the standard three-dimensional posture display, including the movement process of the body and limbs; The personalized three-dimensional pose includes different parameters of the student's training process.

5. The gymnastics movement remote teaching system control method according to claim 1, characterized in that: The step of transmitting the action tag to the student host comprises: The student-side host receives the action labels generated by the action analysis algorithm module, generates an action practice module, and implements the action practice function.

6. The gymnastics movement remote teaching system control method according to claim 5, characterized in that: The student host receives the action tag, generates an action practice module, and implements the action practice function including: Generate an action practice module based on the current action mode of the student host; Using the action practice module, physiological signals, inertial data and surface information are received, and the data is calculated according to the preset algorithm to generate a label that matches the current action; The action label corresponding to the current action is analyzed and compared with the generated action matching label through the pattern matching algorithm, and the comparison result is displayed to the corresponding students to realize the action practice function.

7. The gymnastics movement remote teaching system control method according to claim 6, characterized in that: The pattern matching algorithm adopts a cosine similarity model, including: Establish a pattern space and define action patterns and labels based on human action characteristics; The feature extraction algorithm is used to extract features of the preset actions, and the neural network algorithm is used to train the extracted feature vectors to build a pattern classification model; Train preset actions through deep learning algorithms to build pattern generation models; When the action is executed, the neural network feature vector is generated, and the trained neural network model is calculated, and the results are extracted and fed back from the action pattern library; Calculate the cosine similarity between the feedback result and the feature vector to generate a result set; The result set is calculated through a pattern classification model to generate a matching result.

8. A gymnastics movement remote teaching system, characterized in that: include: A teacher-side host, a wearable processor, a student-side host, a teacher-side wearable device, and a student-side wearable device; the teacher-side host, the wearable processor, and the student-side host are respectively connected to the teacher-side wearable device and the student-side wearable device; The teacher-side host is used to collect the teacher-side human body kinematics information and transmit it to the wearable processor; The wearable processor is used to process human kinematics information and generate motion tags and standard three-dimensional data, transmit the motion tags to the student-side host, and transmit the standard three-dimensional data to the student-side host and the teacher-side wearable device; The student-side host is used to generate personalized three-dimensional data and transmit the personalized three-dimensional data to the teacher-side wearable device; The teacher-side wearable device is used to receive standard three-dimensional data, generate a three-dimensional projection, and project the generated three-dimensional projection into the teacher-side motion space; The student-side wearable device is used to receive standard three-dimensional data and personalized three-dimensional data, generate a virtual training space, and generate a standard three-dimensional projection and a personalized three-dimensional projection in the virtual training space.

9. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the gymnastics movement remote teaching system control method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the gymnastics movement remote teaching system control method according to any one of claims 1 to 7 is implemented.

Images