Interactive simulation teaching method and system based on virtual reality

Abstract

The invention discloses an interactive simulation teaching method and system based on virtual reality, and relates to the field of simulation teaching, and the system comprises a medical teaching simulation platform which comprises a teaching information management module, a medical course teaching module, a virtual teaching construction module, a virtual interaction collection module and a virtual data processing module; the teaching information management module is used for acquiring medical education information and medical knowledge information; the medical course teaching module is used for submitting a medical theory teaching course by a teacher user account and carrying out course theory teaching and assessment; the virtual teaching construction module constructs a virtual interactive analysis model according to the medical theory teaching course, the medical education information and the medical knowledge information; the virtual interaction acquisition module is used for acquiring real-time image information and biomechanical information; the virtual data processing module is used for analyzing and processing the collected data according to a virtual interaction analysis model to obtain virtual feedback information; according to the invention, the interactivity in the teaching process is improved.

Description

Technical Field

[0001] The invention relates to the field of simulation teaching, and in particular to an interactive simulation teaching method and system based on virtual reality. Background Art

[0002] Traditional medical education and training methods mainly rely on traditional media such as textbooks, demonstrations and anatomy. Although these methods can help medical students and medical staff learn and master medical knowledge and skills to a certain extent, they still have many shortcomings in actual clinical operations; for example, theoretical knowledge is difficult to fully transform into practical operation skills, and clinical practice opportunities are limited. In addition, with the continuous development and progress of medical technology, the emergence of new diagnostic and treatment methods and equipment has made traditional medical education and training methods unable to meet current needs; therefore, how to improve the practical ability of medical students and cultivate their ability to solve problems independently has become an urgent problem to be solved;

[0003] A telemedicine education system with publication number CN106530865B discloses a telemedicine education system. The present invention mainly includes a teaching data collection terminal for collecting actual patient medical data information; a consultation and teaching terminal for teaching doctors to diagnose and treat actual patients, and to demonstrate and guide trainees during the diagnosis and treatment process; a learning and practice terminal for trainees to learn and practice remotely; and a server terminal connected to the teaching data collection terminal, the consultation and teaching terminal, and the learning and practice terminal respectively. The present invention combines the telemedicine consultation system with the simulation teaching system, collects patient data in real time to form clinical teaching cases, and combines the situational teaching method, using virtual reality technology to achieve teaching interaction among trainees. Its real clinical education environment helps to cultivate students' initiative, enthusiasm and creativity in learning, train students to form correct clinical thinking, maximize the subjective initiative of learning, significantly improve students' clinical thinking ability, and enhance teaching effectiveness.

[0004] However, in the process of interactive simulation teaching, there is a stereotyped teaching method. Teachers cannot effectively use their personal advantages to conduct simulation teaching, and the teaching objectives cannot be achieved through theoretical explanation alone. However, unscreened virtual interaction greatly increases the teaching cost in the teaching process. Therefore, how to improve the diversity of the simulation teaching process and the utilization of resources in the virtual interactive teaching process is a problem we need to solve. To this end, an interactive simulation teaching method and system based on virtual reality are provided. Summary of the invention

[0005] In order to solve the above technical problems, the purpose of the present invention is to provide an interactive simulation teaching method and system based on virtual reality.

[0006] The object of the present invention can be achieved by the following technical solutions: an interactive simulation teaching system based on virtual reality, comprising a medical teaching simulation platform, wherein the medical teaching simulation platform comprises a teaching information management module, a medical course teaching module, a virtual teaching construction module, a virtual interactive acquisition module, a virtual data processing module and a simulation teaching evaluation module;

[0007] The teaching information management module is used to obtain the medical education information and medical knowledge information of the medical teaching simulation platform, and manage and store them;

[0008] The medical course teaching module is used for teacher user accounts to submit medical theory teaching courses, build virtual medical classrooms, and conduct course theory teaching and assessment for student user accounts;

[0009] The virtual teaching construction module is used to construct a virtual interactive analysis model according to the corresponding medical theory teaching courses, medical education information and medical knowledge information in the virtual medical classroom;

[0010] The virtual interaction acquisition module is used to collect data from student user accounts that have completed course theory teaching and assessment during the virtual interaction process, and obtain corresponding real-time image information and biomechanical information respectively;

[0011] The virtual data processing module is used to input the acquired real-time image information and biomechanical information into the virtual interactive analysis model for analysis and processing, thereby generating virtual feedback information;

[0012] The simulation teaching evaluation module is used to evaluate the virtual interaction process of the students according to the virtual feedback information obtained in the student user account to obtain the evaluation result.

[0013] Furthermore, the teaching information management module obtains the medical education information and medical knowledge information of the medical teaching simulation platform and manages and stores the information, including:

[0014] The teaching information management module is used for inputting corresponding medical education information and medical knowledge information into the medical teaching simulation platform;

[0015] Classify the medical knowledge information and set a corresponding classification system structure, wherein the classification system structure sets a graph node according to the corresponding department, sets a graph sub-node according to the classification results of the medical knowledge information in different medical departments, generates a medical professional knowledge graph with the set graph nodes and graph sub-nodes, and stores the corresponding medical knowledge information;

[0016] The obtained medical education information is compared and analyzed with the corresponding classification system structure in the medical professional knowledge map, and medical course catalog information is generated according to the comparison and analysis results, and the medical education information is stored.

[0017] Furthermore, in the medical course teaching module, the teacher user account submits the medical theory teaching course, builds a virtual medical classroom, and conducts course theory teaching and assessment on the student user account, including:

[0018] The medical course teaching module is used for teacher user accounts to build virtual medical classrooms, submit corresponding medical theory teaching courses to the virtual medical classroom, and set permissions for corresponding student user accounts to enter the virtual medical classroom;

[0019] Conduct course theory teaching according to the medical theory teaching course, obtain the completion status of the corresponding student user account, and determine whether to grant the assessment authority based on the completion status;

[0020] The medical theory teaching courses in the virtual medical classroom are compared and analyzed with the medical professional knowledge map and the medical course catalog information. The corresponding medical knowledge information and medical education information are obtained based on the comparative analysis results. A pre-processed test paper is generated based on the obtained information, which is adapted and processed by the teacher user account to generate theoretical assessment information. The student user account responds, and it is judged whether the assessment is completed based on the response result.

[0021] Furthermore, the process of constructing the virtual interactive analysis model by the virtual teaching construction module includes:

[0022] The virtual teaching construction module obtains medical education information and medical knowledge information corresponding to the medical theory teaching courses in the virtual medical classroom, wherein the medical knowledge information includes medical pathology data, medical anatomy data, physiological reference data, medical imaging data, and clinical diagnosis and treatment data; the medical education information includes simulated human body equipment, medical equipment data, tactile feedback data, and virtual display data;

[0023] According to the different settings of the data types of the obtained medical education information and medical knowledge information, the corresponding virtual data sets are marked as three types: virtual physiological structure data set, biomechanical structure data set and virtual pathological feedback data set. The three types of data sets are analyzed and trained based on the deep learning algorithm, and the corresponding physiological structure sub-model, mechanical structure sub-model and pathological feedback sub-model are constructed respectively.

[0024] The obtained physiological structure sub-model, mechanical structure sub-model and pathological feedback sub-model are integrated and trained to construct a virtual interaction analysis model. The obtained virtual interaction analysis model and the corresponding virtual interaction equipment are trained and debugged, and the virtual interaction analysis model and virtual interaction equipment that have completed training and debugging are linked to each other.

[0025] Furthermore, the process of the virtual interaction acquisition module acquiring real-time image information and biomechanical information includes:

[0026] The virtual interactive acquisition module is associated with the corresponding virtual interactive device, and the virtual interactive device is respectively provided with an image acquisition terminal and a mechanical monitoring terminal;

[0027] The image acquisition terminal is used to collect real-time image information of student user accounts that have completed course theory teaching and assessment during the virtual interaction process using the virtual interactive device;

[0028] The mechanical monitoring terminal is used to collect biomechanical information of student user accounts that have completed course theoretical teaching and assessment during the virtual interaction process using virtual interactive devices.

[0029] Furthermore, the process of generating virtual feedback information by the virtual data processing module includes:

[0030] The virtual data processing module obtains the real-time image information and biomechanical information obtained in the virtual interactive acquisition module, inputs the real-time image information and biomechanical information into the virtual interactive analysis model, analyzes and processes them by the mechanical structure sub-model therein, obtains real-time physiological impact data, analyzes and processes the pathological feedback sub-model according to the real-time physiological impact data, obtains real-time virtual pathological reflection data, analyzes and processes the real-time virtual pathological reflection data by the physiological structure sub-model, and generates real-time virtual display result data;

[0031] The virtual interactive analysis model integrates the obtained real-time physiological impact data, real-time virtual pathological reflection data and real-time virtual display result data to generate virtual feedback information, and sends it to the simulation teaching evaluation module.

[0032] Furthermore, the simulation teaching evaluation module evaluates the virtual interaction process of the student according to the virtual feedback information obtained in the student user account, and the process of obtaining the evaluation result includes:

[0033] The simulation teaching evaluation module obtains virtual feedback information of the virtual interaction analysis model in the corresponding student user account on the virtual interaction process, sets the process sequence of the virtual interaction process according to the medical theory teaching course corresponding to the virtual interaction analysis model, and sets the corresponding virtual feedback standard data according to the process sequence;

[0034] The obtained virtual feedback information is compared and analyzed with the virtual feedback standard data corresponding to the corresponding process sequence, and the process evaluation data is obtained based on the comparative analysis results. All process evaluation data in the virtual interactive analysis model are comprehensively analyzed to obtain the feedback results corresponding to the corresponding student user account.

[0035] Compared with the prior art, the present invention has the following beneficial effects:

[0036] 1. Submit medical theory teaching courses through teacher user accounts, build corresponding virtual medical classrooms, and set corresponding permissions for student user accounts, which to a certain extent ensures the personalization of teachers' teaching process and avoids the stereotyped simulation teaching methods in the medical teaching simulation platform. In addition, by setting corresponding theoretical assessment information for student user accounts and setting virtual interaction permissions for student user accounts that have completed theoretical assessments, resource waste is reduced to a certain extent;

[0037] 2. By setting up the physiological structure sub-model, the mechanical structure sub-model and the pathological feedback sub-model to construct a virtual interactive analysis model, the coordination of the virtual interactive analysis model in the process of analyzing and processing data information is improved to a certain extent. In addition, the teacher user account sets the corresponding dynamic interactive information in the process of dynamically managing the student user account, and the dynamic interactive information is analyzed and processed through the corresponding virtual interactive analysis model, which ensures the stability of the virtual interaction process to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a schematic diagram of an interactive simulation teaching system based on virtual reality according to an embodiment of the present application;

[0039] Figure 2 This is a flowchart of a virtual reality-based interactive simulation teaching method according to an embodiment of the present application. DETAILED DESCRIPTION

[0040] like Figure 1 As shown, an interactive simulation teaching system based on virtual reality includes a medical teaching simulation platform, wherein the medical teaching simulation platform includes a teaching information management module, a medical course teaching module, a virtual teaching construction module, a virtual interactive acquisition module, a virtual data processing module and a simulation teaching evaluation module;

[0041] The teaching information management module is used to obtain the user identity information of the medical teaching simulation platform, grant the corresponding user's authority and user account according to the user identity information, and manage the medical teaching information in the medical teaching simulation platform. The specific implementation process includes:

[0042] The teaching information management module is provided with an identity authentication unit and an information management unit;

[0043] An identity entry window is provided in the identity authentication unit, and a teacher entry window and a student entry window are provided in the identity entry window. The teacher entry window and the student entry window are respectively used for teacher users and student users who use the medical teaching simulation platform to enter user identity information, and different entry standards are set for the user identity information according to the differences between teacher users and student users; the entry standards are set according to different user identities; the user identity information corresponding to the teacher user includes educational background information, professional qualification information, name, contact number after real-name authentication, and teaching position information; the user identity information corresponding to the student user includes name, department information, and contact number after real-name authentication; the obtained user identity information is respectively verified according to the entry standards, and a student user account and a teacher user account are set according to the verification processing results, and the corresponding user sets the corresponding user login password according to the user account set by the corresponding user;

[0044] The information management unit is used to obtain medical education information and medical knowledge information in the medical teaching simulation platform, wherein the medical education information is historical education information using the medical teaching simulation platform, and the medical knowledge information includes medical expertise of different departments;

[0045] The information management unit is provided with a medical education storage space and a medical knowledge storage space, which are used to store the medical education information and medical knowledge information in the medical education simulation platform respectively;

[0046] The medical knowledge storage space acquires medical expertise from different departments, classifies the medical expertise in different departments, sets a corresponding classification system structure according to the department to which the medical expertise belongs and the classification result, sets corresponding graph nodes according to the corresponding departments, sets graph sub-nodes according to the classification result of the medical expertise in different medical departments, and generates a medical expertise graph with the set graph nodes and graph sub-nodes; the medical knowledge storage space performs distributed storage according to the generated medical expertise graph;

[0047] The medical education storage space obtains medical education information and a medical professional knowledge map in a medical education simulation platform; compares and analyzes the obtained medical education information with the corresponding classification system results in the medical professional knowledge map, generates medical course catalog information based on the comparison and analysis results, and stores the corresponding medical education information based on the generated medical course catalog information.

[0048] The medical course teaching module is provided with a theoretical teaching unit and a theoretical assessment unit;

[0049] The theoretical teaching unit is used for the corresponding teacher user account to set up a virtual medical classroom, and the corresponding teacher user account submits the corresponding medical theory teaching course, and uploads the obtained medical theory teaching course to the virtual medical classroom. The virtual medical classroom is used for the teacher user account to conduct theoretical teaching according to the medical theory teaching course submitted by the teacher user account, and set the authority of the corresponding student user account to enter the virtual medical classroom;

[0050] The theoretical teaching unit obtains the completion status of the medical theory teaching course by the corresponding student user account in the virtual medical classroom, obtains the theoretical learning information in the student user account entering the virtual medical classroom, the theoretical learning information includes the learning time, learning content and learning focus data of the corresponding student user account, and the learning focus data includes the correct rate of the in-class test during the teaching process of the medical theory teaching course; analyzes and processes the learning time and learning focus data according to the learning content in the theoretical learning information;

[0051] The obtained learning time is marked as t1, the total time of medical theory courses in the virtual medical classroom is marked as T, and the learning time ratio is obtained and marked as t1 / T; the obtained learning focus data is marked as Z; the corresponding weighting coefficients are set to α and β respectively; the theoretical course data of the corresponding student user account is obtained according to the above data, and it is marked as K, where the calculation process of the course theory data is:

[0052]

[0053] The theory assessment unit is used to analyze and process the course theory data in the student user account, preset the course theory standard data, and compare and analyze the course theory data corresponding to the student user account with the corresponding course theory standard data;

[0054] When the course theory data is greater than or equal to the corresponding course theory standard data, the corresponding student user account is granted the authority to conduct theory assessment;

[0055] When the course theory data is less than the corresponding course theory standard data, the corresponding student user account will not be granted the authority to conduct theory assessment;

[0056] The theory assessment unit obtains the medical theory teaching courses in the virtual medical classroom where the student user account is located;

[0057] Match the obtained medical theory teaching courses with the medical professional knowledge map set in the information management unit to obtain medical professional knowledge that matches the medical theory teaching courses;

[0058] Obtaining a corresponding medical professional question bank according to the acquired medical professional knowledge, randomly extracting a corresponding number of medical professional test questions according to the medical professional question bank, generating a pre-processed test paper according to the acquired medical professional test questions, and sending the acquired pre-processed test paper to the teacher user account;

[0059] The teacher user account rewrites the obtained pre-processed test paper to generate theoretical examination information, and sends the theoretical examination information to the student user account with theoretical examination authority, and the corresponding student user account replies to the obtained theoretical examination information to obtain theoretical examination reply data;

[0060] Preset theoretical assessment response standard data, and compare and analyze the obtained theoretical assessment response data with the theoretical assessment response standard data;

[0061] When the theoretical examination reply data is greater than or equal to the theoretical examination reply standard data, the student user account is sent to the virtual interaction collection module;

[0062] When the theoretical assessment response data is less than the theoretical assessment response standard data, the student user account is sent to the theoretical teaching unit to repeat the study of the medical theory teaching course in the virtual medical classroom.

[0063] The virtual teaching construction module is provided with a virtual medical classroom constructed by obtaining the medical course catalog information stored in the medical education storage space and the corresponding teacher user account;

[0064] Comparative analysis is performed on the corresponding medical theory teaching courses in the virtual medical classroom and the corresponding medical professional knowledge maps in the medical education storage space, and corresponding medical knowledge information and medical education information corresponding to the corresponding medical course catalog information are obtained according to the comparative analysis results;

[0065] The medical knowledge information includes medical pathology data, medical anatomical data, physiological reference data, medical imaging data and clinical diagnosis and treatment data, among which:

[0066] Medical pathology data includes the physiological process, pathological characteristics and effects of the corresponding disease;

[0067] Medical anatomical data includes the structure, organ location, size, and function information of human body systems, which is used to build realistic human models and medical scenes;

[0068] Physiological reference data include various parameters of human physiological activities, such as heart rate, respiratory rate, blood pressure and other reference data, which are used to simulate the patient's response under different physiological conditions;

[0069] Medical imaging data includes image data obtained by medical equipment such as X-rays, CT scans, and MRIs, which are used to visualize the simulated human body;

[0070] Clinical diagnosis and treatment data include diagnostic criteria, treatment procedures and surgical procedures for various diseases;

[0071] The medical education information includes human body simulation equipment, sound simulation data, medical device equipment data, tactile feedback data and virtual display data, wherein:

[0072] Human body simulation equipment is a highly realistic human body simulation, including models of the whole body or specific parts;

[0073] The sound simulation data refers to the sound effect data during the medical simulation process;

[0074] Medical equipment data refers to the medical equipment needed in the medical simulation process and the corresponding physical and mechanical processing data;

[0075] The tactile feedback data is the tactile biomechanical data of the hand in the virtual environment;

[0076] The virtual display data is image data of the corresponding virtual interactive device in the virtual environment;

[0077] The virtual interaction model is constructed according to the medical education information matched with each other in the virtual medical classroom, and the process includes:

[0078] According to the different virtual data sets corresponding to the types of matched medical education information and medical knowledge information, the set virtual data sets are classified and marked as three types: virtual physiological structure data set, biomechanical structure data set and virtual pathological feedback data set;

[0079] The virtual physiological structure data set includes corresponding medical pathological data, physiological reference data, simulated human body equipment, medical anatomical data, virtual display data and medical imaging data. The obtained virtual physiological structure data set is used to construct a corresponding physiological structure sub-model based on a deep learning algorithm. The physiological structure sub-model is used to generate real-time virtual display result data of the corresponding virtual scene according to the physiological data and pathological data at the corresponding moment;

[0080] The biomechanical structure data set includes corresponding virtual display data, medical equipment data, tactile feedback data, simulated human equipment, medical anatomy data and clinical diagnosis and treatment data. The obtained physiological mechanical structure data set is used to construct a corresponding mechanical structure sub-model based on a deep learning algorithm. The mechanical structure sub-model is used to generate corresponding effects based on the real-time image information and physiological mechanical information of the student user account at the time of acquisition in the corresponding simulated human equipment, and the effects are marked as real-time physiological impact data;

[0081] The virtual pathology feedback data set includes corresponding physiological reference data, clinical diagnosis and treatment data, simulated human body equipment, medical anatomical data and virtual display data. The obtained virtual pathology feedback data set is used to construct a corresponding pathology feedback sub-model based on a deep learning algorithm. The pathology feedback sub-model is used to mark the real-time virtual medical record reflection data as real-time virtual medical record reflection data according to the reaction principle of the corresponding situation in the simulated human body equipment caused by the real-time physiological impact data obtained by the student user account in the virtual interaction process;

[0082] The obtained physiological structure sub-model, mechanical structure sub-model and pathological feedback sub-model are integrated and trained to construct a virtual interaction analysis model. The obtained virtual interaction analysis model and the corresponding virtual interaction equipment are systematically trained and debugged. The virtual interaction analysis model and the virtual interaction equipment that have completed virtual training and debugging are linked to each other and stored.

[0083] The virtual interaction acquisition module is used for the corresponding user account to perform interactive operations according to the virtual interaction analysis module, set the head-mounted display, map the obtained virtual interaction analysis model into the head-mounted display, and obtain real-time image information and biomechanical information;

[0084] The virtual interactive acquisition module is provided with an image acquisition unit and a mechanical acquisition unit;

[0085] The image acquisition unit is associated with a corresponding virtual interactive device, and the virtual interactive device is used for displaying virtual images of student user accounts during virtual interaction, and completing virtual interaction according to the virtual image display;

[0086] The virtual interactive device is provided with a corresponding image acquisition terminal, which is used to monitor the virtual interactive process of the student user account in real time and obtain real-time image information;

[0087] Marking the time of acquiring the real-time image information, setting the marking result as the acquisition time, and sending the acquired real-time image information and the acquisition time to the virtual data processing module;

[0088] The mechanical acquisition unit is associated with the data of the simulated human body equipment and the medical device equipment. The simulated human body equipment and the medical device equipment are equipped with mechanical monitoring terminals. The mechanical monitoring terminals are used to obtain the human body mechanical data and the device mechanical data of the student user account during the virtual interaction process, mark the obtained acquisition time, and send the obtained human body mechanical data and the device mechanical data and the corresponding acquisition time to the virtual data processing module;

[0089] It should be further explained that, in the specific implementation process, a data transmission unit is provided in the virtual interactive module, and the data transmission unit is used to obtain real-time image information in the virtual head display device and transmit it to the corresponding teacher user account in the virtual medical classroom. The teacher user account is personalized according to the real-time image information obtained.

[0090] The virtual data processing module is used to analyze and process the real-time image information and biomechanical information obtained by the user, generate corresponding virtual feedback information, send the obtained virtual feedback information to the virtual interaction acquisition module, and repeat the operation. The specific implementation process includes:

[0091] The virtual data processing module is provided with a virtual control unit and a virtual processing unit;

[0092] The virtual control unit is used to connect the teacher user account to the data transmission unit in the corresponding student user account respectively. The teacher user account sets dynamic interactive information according to the real-time image information of the corresponding student user account at the current moment. The dynamic interactive information may include teacher demonstration data, temporary emergency data or parameter adjustment data. In the process of setting the dynamic interactive information by the teacher user account, it is sent to the corresponding student user account through the data transmission unit.

[0093] The virtual processing unit is used to obtain real-time image information, human body mechanics data and instrument mechanics data and the acquisition time corresponding to the corresponding data information;

[0094] A corresponding virtual interactive analysis model is provided in the virtual processing unit, and the acquired data information is sent to the virtual interactive analysis model, which analyzes and processes the data information;

[0095] Obtaining the acquisition time corresponding to the corresponding data of human body mechanics data, instrument mechanics data and real-time image data, inputting the obtained human body mechanics data, instrument mechanics data and real-time image data into the mechanical structure sub-model for analysis and processing, and obtaining the corresponding real-time physiological impact data;

[0096] The obtained real-time physiological impact data is sent to the pathological feedback sub-model, which analyzes and processes the data to obtain corresponding real-time virtual pathological reflection data;

[0097] The obtained real-time virtual pathological reflection data is sent to the physiological structure sub-model, which analyzes and processes the data to obtain corresponding real-time virtual display result data;

[0098] Mapping the obtained real-time virtual display result data into the virtual interaction acquisition unit, generating corresponding images and analyzing and processing them;

[0099] The virtual interactive analysis model integrates the obtained real-time physiological impact data, real-time virtual pathological reflection data and real-time virtual display result data to generate virtual feedback information;

[0100] It should be further explained that, in the specific implementation process, the virtual processing unit, in the process of analyzing and processing the data information, gives priority to obtaining the dynamic interactive information set by the teacher user account in the virtual management and control unit, integrates the obtained dynamic interactive information with the currently obtained data information, and inputs the integrated data information into the virtual interactive analysis model for analysis and processing.

[0101] The simulation teaching evaluation module is used to evaluate the virtual interaction process of the corresponding user according to the virtual feedback information obtained in the corresponding user account, and store the obtained evaluation results. The specific implementation process includes:

[0102] The simulation teaching evaluation module is provided with a basic evaluation unit and a comprehensive evaluation unit;

[0103] The basic evaluation unit obtains a corresponding virtual interaction analysis model, sets a process sequence in the virtual interaction process according to the virtual interaction analysis model, marks the obtained process sequence as a basic process sequence, and sets corresponding virtual feedback standard data for the basic process data;

[0104] The obtained human body mechanics data, instrument mechanics data and real-time image information are classified and processed according to the corresponding basic process sequence, and the virtual feedback information of the corresponding acquisition time is obtained according to the classification result;

[0105] Compare and analyze the obtained virtual feedback information with the virtual feedback standard data corresponding to the corresponding basic process sequence, and obtain corresponding similarity data according to the comparison and analysis results; mark the obtained similarity data as process evaluation data of the corresponding basic process sequence;

[0106] Comprehensively analyze all process evaluation data in the virtual interactive analysis model to obtain feedback results corresponding to the corresponding student user accounts;

[0107] The comprehensive evaluation unit is used for the teacher user account to evaluate the virtual interaction process of the student user account in the corresponding virtual medical classroom to generate teacher evaluation data;

[0108] Comprehensively analyze the teacher evaluation data and feedback results obtained, generate comprehensive feedback results, and send them to the student user account;

[0109] The teaching process and virtual interaction process in the virtual medical classroom are marked as medical education information and stored.

[0110] like Figure 2 As shown, an interactive simulation teaching method based on virtual reality includes the following steps:

[0111] Step S1: Setting up a medical teaching simulation platform, obtaining medical education information and medical knowledge information of the medical teaching simulation platform, and storing the obtained information;

[0112] Step S2: The teacher user account submits the corresponding medical theory teaching course, builds a virtual medical classroom based on the medical theory teaching course, and conducts course theory teaching and assessment for the student user account based on the virtual medical classroom;

[0113] Step S3: Obtain the corresponding medical theory teaching courses and the corresponding medical education information and medical knowledge information in the virtual medical classroom, build a virtual interactive analysis model based on the obtained data information, and associate it with the virtual interactive device;

[0114] Step S4: collecting data from student user accounts that have completed course theory teaching and assessment during the process of using virtual interactive devices for virtual interaction, and obtaining corresponding real-time image information and biomechanical information;

[0115] Step S5: inputting the obtained real-time image information and biomechanical information into a virtual interactive analysis model associated with the virtual interactive device for analysis and processing to generate virtual feedback information;

[0116] Step S6: Evaluate the virtual interaction process of the student according to the virtual feedback information obtained in the student user account to obtain the evaluation result.

[0117] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. An interactive simulation teaching system based on virtual reality, including a medical teaching simulation platform, characterized in that: The medical teaching simulation platform includes a teaching information management module, a medical course teaching module, a virtual teaching construction module, a virtual interactive acquisition module, a virtual data processing module and a simulation teaching evaluation module; The teaching information management module is used to obtain the medical education information and medical knowledge information of the medical teaching simulation platform, and manage and store them; The medical course teaching module is used for teacher user accounts to submit medical theory teaching courses, build virtual medical classrooms, and conduct course theory teaching and assessment for student user accounts; The virtual teaching construction module is used to construct a virtual interactive analysis model according to the corresponding medical theory teaching courses, medical education information and medical knowledge information in the virtual medical classroom; The virtual interaction acquisition module is used to collect data from student user accounts that have completed course theory teaching and assessment during the virtual interaction process, and obtain corresponding real-time image information and biomechanical information respectively; The virtual data processing module is used to input the acquired real-time image information and biomechanical information into the virtual interactive analysis model for analysis and processing, thereby generating virtual feedback information; The simulation teaching evaluation module is used to evaluate the virtual interaction process of the students according to the virtual feedback information obtained in the student user account to obtain the evaluation result.

2. The interactive simulation teaching system based on virtual reality according to claim 1, characterized in that: The process of the teaching information management module acquiring the medical education information and medical knowledge information of the medical teaching simulation platform and managing and storing the information includes: The teaching information management module is used for inputting corresponding medical education information and medical knowledge information into the medical teaching simulation platform; Classify the medical knowledge information and set a corresponding classification system structure, wherein the classification system structure sets a graph node according to the corresponding department, sets a graph sub-node according to the classification results of the medical knowledge information in different medical departments, generates a medical professional knowledge graph with the set graph nodes and graph sub-nodes, and stores the corresponding medical knowledge information; The obtained medical education information is compared and analyzed with the corresponding classification system structure in the medical professional knowledge map, and medical course catalog information is generated according to the comparison and analysis results, and the medical education information is stored.

3. The interactive simulation teaching system based on virtual reality according to claim 2, characterized in that: In the medical course teaching module, the teacher user account submits the medical theory teaching course, builds a virtual medical classroom, and conducts course theory teaching and assessment for the student user account, including: The medical course teaching module is used for teacher user accounts to build virtual medical classrooms, submit corresponding medical theory teaching courses to the virtual medical classroom, and set permissions for corresponding student user accounts to enter the virtual medical classroom; Conduct course theory teaching according to the medical theory teaching course, obtain the completion status of the corresponding student user account, and determine whether to grant the assessment authority based on the completion status; The medical theory teaching courses in the virtual medical classroom are compared and analyzed with the medical professional knowledge map and the medical course catalog information. The corresponding medical knowledge information and medical education information are obtained based on the comparative analysis results. A pre-processed test paper is generated based on the obtained information, which is adapted and processed by the teacher user account to generate theoretical assessment information. The student user account responds, and it is judged whether the assessment is completed based on the response result.

4. The interactive simulation teaching system based on virtual reality according to claim 3 is characterized in that: The process of constructing the virtual interactive analysis model by the virtual teaching construction module includes: The virtual teaching construction module obtains medical education information and medical knowledge information corresponding to the medical theory teaching courses in the virtual medical classroom, wherein the medical knowledge information includes medical pathology data, medical anatomy data, physiological reference data, medical imaging data, and clinical diagnosis and treatment data; the medical education information includes simulated human body equipment, medical equipment data, tactile feedback data, and virtual display data; According to the different settings of the data types of the obtained medical education information and medical knowledge information, the corresponding virtual data sets are marked as three types: virtual physiological structure data set, biomechanical structure data set and virtual pathological feedback data set. The three types of data sets are analyzed and trained based on the deep learning algorithm, and the corresponding physiological structure sub-model, mechanical structure sub-model and pathological feedback sub-model are constructed respectively. The obtained physiological structure sub-model, mechanical structure sub-model and pathological feedback sub-model are integrated and trained to construct a virtual interaction analysis model. The obtained virtual interaction analysis model and the corresponding virtual interaction equipment are trained and debugged, and the virtual interaction analysis model and virtual interaction equipment that have completed training and debugging are linked to each other.

5. The interactive simulation teaching system based on virtual reality according to claim 4, characterized in that: The process of collecting real-time image information and biomechanical information by the virtual interactive collection module includes: The virtual interactive acquisition module is associated with the corresponding virtual interactive device, and the virtual interactive device is respectively provided with an image acquisition terminal and a mechanical monitoring terminal; The image acquisition terminal is used to collect real-time image information of student user accounts that have completed course theory teaching and assessment during the virtual interaction process using the virtual interactive device; The mechanical monitoring terminal is used to collect biomechanical information of student user accounts that have completed course theoretical teaching and assessment during the virtual interaction process using virtual interactive devices.

6. The interactive simulation teaching system based on virtual reality according to claim 5, characterized in that: The process of generating virtual feedback information by the virtual data processing module includes: The virtual data processing module obtains the real-time image information and biomechanical information obtained in the virtual interactive acquisition module, inputs the real-time image information and biomechanical information into the virtual interactive analysis model, analyzes and processes them by the mechanical structure sub-model therein, obtains real-time physiological impact data, analyzes and processes the pathological feedback sub-model according to the real-time physiological impact data, obtains real-time virtual pathological reflection data, analyzes and processes the real-time virtual pathological reflection data by the physiological structure sub-model, and generates real-time virtual display result data; The virtual interactive analysis model integrates the obtained real-time physiological impact data, real-time virtual pathological reflection data and real-time virtual display result data to generate virtual feedback information, and sends it to the simulation teaching evaluation module.

7. The interactive simulation teaching system based on virtual reality according to claim 6, characterized in that: The simulation teaching evaluation module evaluates the virtual interaction process of the student according to the virtual feedback information obtained in the student user account. The process of obtaining the evaluation result includes: The simulation teaching evaluation module obtains virtual feedback information of the virtual interaction analysis model in the corresponding student user account on the virtual interaction process, sets the process sequence of the virtual interaction process according to the medical theory teaching course corresponding to the virtual interaction analysis model, and sets the corresponding virtual feedback standard data according to the process sequence; The obtained virtual feedback information is compared and analyzed with the virtual feedback standard data corresponding to the corresponding process sequence, and the process evaluation data is obtained based on the comparative analysis results. All process evaluation data in the virtual interactive analysis model are comprehensively analyzed to obtain the feedback results corresponding to the corresponding student user account.

8. An interactive simulation teaching method based on virtual reality, specifically applied to an interactive simulation teaching system based on virtual reality as claimed in any one of claims 1 to 7, characterized in that: The following steps are involved: Step S1: Setting up a medical teaching simulation platform, obtaining medical education information and medical knowledge information of the medical teaching simulation platform, and storing the obtained information; Step S2: The teacher user account submits the corresponding medical theory teaching course, builds a virtual medical classroom based on the medical theory teaching course, and conducts course theory teaching and assessment for the student user account based on the virtual medical classroom; Step S3: Obtain the corresponding medical theory teaching courses and the corresponding medical education information and medical knowledge information in the virtual medical classroom, build a virtual interactive analysis model based on the obtained data information, and associate it with the virtual interactive device; Step S4: collecting data from student user accounts that have completed course theory teaching and assessment during the process of using virtual interactive devices for virtual interaction, and obtaining corresponding real-time image information and biomechanical information; Step S5: inputting the obtained real-time image information and biomechanical information into a virtual interactive analysis model associated with the virtual interactive device for analysis and processing to generate virtual feedback information; Step S6: Evaluate the virtual interaction process of the student according to the virtual feedback information obtained in the student user account to obtain the evaluation result.

Images