Operation training system and method based on virtual reality

Abstract

The invention relates to the field of medical education and training. The invention discloses a virtual reality-based operation training system and method, and the system comprises a data collection module which is used for collecting operation related data, a simulation training module which is connected to a data processing and modeling module and is used for the operation simulation training of students, and an evaluation module which is connected to the simulation training module and the data processing and modeling module and is used for the operation simulation training of students. The teaching assisting module is connected to the simulation training module and the evaluation module, and the system management module is used for managing the operation training system. According to the operation training system and method based on virtual reality, various data of an operation can be collected through the data collection module comprising a plurality of sub-modules, the operation force of an operation instrument, the pressure of an operation simulation scene and the operation pressure distribution data of a human body model can also be collected, and basic information is provided for subsequent training and analysis. The simulation training module provides a plurality of operation scenes and training modes. The evaluation module performs quantitative evaluation on multiple aspects of the trainees.

Description

Technical Field

[0001] The present invention relates to the field of medical education and training, and particularly to a surgical training system and method based on virtual reality. Background Art

[0002] Surgical operations play a crucial role in the medical field, and their complexity poses extremely high requirements for doctors' skill levels. The traditional surgical training methods mainly include cadaver operations and animal experiments. Cadaver resources are scarce, and the acquisition process is restricted by multiple factors such as ethics and morality, making it difficult to meet the increasing demand for surgical training. Animal experiments are not only costly but also face ethical disputes regarding animal protection. Moreover, the physiological structure of animals is different from that of humans, and it is impossible to accurately reproduce the real scenarios of human surgeries.

[0003] With the development of technology, virtual reality technology has gradually matured, opening up new directions for surgical training. Currently, there are already many surgical training systems based on virtual reality technology. Some systems can simulate basic surgical procedures, enabling trainees to carry out simple operation exercises in a virtual environment. However, these existing technologies have many deficiencies. At the data collection level, most systems can only collect a small amount of basic data, such as simple operation step records, and it is difficult to comprehensively collect key information such as the operation force of surgical instruments, pressure data in the surgical simulation scenario, and pressure distribution data when trainees operate on a human model, resulting in insufficient data support for subsequent analysis. From the perspective of the simulation training scenario, the richness of the scenario is severely lacking. Most systems only provide a limited number of common surgical scenarios, and the scenario details are not realistic enough to simulate the complex situations of surgeries in different departments and different difficulty levels, making it difficult to meet the diverse needs of trainees at different learning stages. Trainees lack adaptability when facing complex and diverse surgical scenarios in actual clinical work. In the evaluation link, the evaluation methods of existing systems are relatively single and lack accuracy. Most of them only make simple judgments based on whether the operation steps are correct, and it is difficult to conduct a comprehensive and objective quantitative evaluation of trainees' operation accuracy, operation speed, teamwork ability, etc. In terms of teamwork training, although some systems have a teamwork training mode, the actual effect is not good. The system cannot reasonably allocate tasks and operation permissions for trainees according to the responsibilities and operation processes of different roles. There are obstacles to real-time communication and collaboration among trainees, making it difficult to effectively test trainees' teamwork ability and emergency handling ability. Moreover, it is difficult for the instructor to conveniently monitor the trainees' training process in real time through the existing system, and it is impossible to add detailed annotations in a timely manner when trainees are training. The function of formulating personalized teaching plans is also not perfect enough, and it is difficult to formulate targeted teaching plans based on trainees' evaluation reports and personal characteristics. The practicality and convenience of the teaching resource sharing function also need to be improved. Summary of the Invention

[0004] To address the deficiencies of the prior art, the present invention discloses a virtual reality-based surgical training system and method that can comprehensively collect surgical-related data, achieve precise evaluation, provide rich simulation training scenarios, and offer an efficient teaching assistant function.

[0005] The present invention discloses a virtual reality-based surgical training system and method, which includes:

[0006] A data acquisition module: used to collect surgical-related data;

[0007] A data processing and modeling module: connected to the data acquisition module, used to process the collected data;

[0008] A simulation training module: connected to the data processing and modeling module, used for trainees to conduct surgical simulation training; An evaluation module: connected to the simulation training module and the data processing and modeling module;

[0009] A teaching assistant module: connected to the simulation training module and the evaluation module, providing an assistant function for teaching teachers; A system management module: used to manage the surgical training system, including user account management, data security management, system settings, and model update management.

[0010] Further, the data acquisition module includes:

[0011] A surgical instrument information acquisition sub-module, used to collect data on the model, appearance, function, and usage method of surgical instruments;

[0012] A surgical environment information acquisition sub-module, used to collect environmental data on the layout of the operating room, equipment placement, and lighting conditions;

[0013] A surgical video acquisition sub-module, used to collect surgical video materials of different doctors;

[0014] An operating room personnel information acquisition sub-module, used to input data on the basic information, professional skills, and surgical experience of doctors, nurses, and anesthesiologists in the operating room;

[0015] A trainee operation acquisition sub-module, used to record the operation behavior, operation time, and operation result data of trainees during the simulation training process.

[0016] Further, the data processed by the data processing and modeling module includes:

[0017] Sort out the surgical instrument data and surgical environment data, and construct a surgical instrument model and a surgical environment model;

[0018] Analyze the doctor's surgical video data, extract information on the doctor's surgical habits, instrument usage methods, and intraoperative cooperation key points, and establish an operating room personnel database;

[0019] According to the surgical procedures and specifications, a preoperative instrument preparation simulation model, a general simulation model for cooperation with doctors during the operation, and a specific simulation model for cooperation with specific doctors are constructed, and an evaluation standard library based on the operation data of trainees is established;

[0020] The evaluation module quantitatively evaluates the operation accuracy, operation speed, and teamwork ability of trainees during the simulation training according to the evaluation standard library, and generates an evaluation report.

[0021] Furthermore, the simulation training module further includes: a scenario selection sub-module, which is used to select different types of surgical scenarios for training, including surgeries in different departments and surgeries with different difficulty levels;

[0022] a training mode selection sub-module, which provides a single-person training mode and a teamwork training mode;

[0023] a random question generation sub-module, which is used to randomly generate training questions, randomly specify the required instruments, and randomly generate unexpected surgical situations according to the currently selected surgical scenario and training content; an operation feedback sub-module, which monitors the operation behavior of trainees in real time, compares it with the preset correct operation, gives positive feedback for correct operations, and gives error prompts and corrective suggestions for incorrect operations.

[0024] Furthermore, the data acquisition module: is used to acquire the operation force data of surgical instruments, the pressure data in the surgical simulation scenario, and the pressure distribution data when trainees operate on the human model. The data acquisition module includes several pressure sensors;

[0025] The data processing and modeling module: processes and analyzes the acquired pressure data, establishes a pressure evaluation model, and processes the pressure data using the finite element analysis algorithm;

[0026] The simulation training module: includes a force acquisition module and a human model module. The force acquisition module is used to acquire the force data of trainees operating surgical instruments in real time, and the human model module simulates the pressure feedback and mechanical properties of different parts of the human body;

[0027] The evaluation module: The evaluation module is connected to the simulation training module and the data processing and modeling module. According to the pressure evaluation model, it quantitatively evaluates the operation accuracy, force control, and pressure response ability of trainees during the simulation training, generates an evaluation report, and the evaluation report includes index analysis and improvement suggestions.

[0028] Furthermore, the force acquisition module uses a pressure measurement sub-unit to acquire the human pressure data in the area of the human model module;

[0029] The force acquisition module processes the human body pressure data using the finite element analysis algorithm, divides the human body model module area into multiple tiny units, each unit corresponding to a pressure sensor data point. By establishing a human body pressure distribution model, the human body pressure gradient and stress distribution of the entire area are calculated based on the pressure values of each point;

[0030] The threshold judgment method is used to judge the human body pressure of the force acquisition module. The normal human body pressure range threshold is set. When the pressure in a certain area is detected to exceed the threshold range, it is determined that the pressure in this area is abnormal;

[0031] The pressure abnormal areas that exceed the normal upper limit by 10% for more than 5 seconds are marked to indicate the existence of abnormal situations where the surgical force exceeds the standard.

[0032] Furthermore, the pressure data acquisition in the data acquisition module includes several pressure sensors set on the surgical instrument, which collects the instrument pressure data applied by the trainee during the operation of the instrument, and compares the instrument pressure data with the human body pressure data tested by the pressure measurement subunit. When the pressure difference between the instrument pressure data and the human body pressure data is less than or equal to 12%, the actual pressure is the average value between the instrument pressure data and the human body pressure data. When the pressure difference between the instrument pressure data and the human body pressure data is greater than 12%, the pressure abnormality is displayed.

[0033] Furthermore, the evaluation module evaluates the pressure-related operations: force accuracy evaluation, to judge whether the force applied by the trainee during the operation of the surgical instrument conforms to the surgical operation specifications and requirements, and calculates the force error rate;

[0034] Pressure coping ability evaluation, setting pressure abnormal situations during the simulated operation process to evaluate the trainee's coping ability to pressure changes, including whether they can adjust the operation force in time and take correct coping measures; comprehensive pressure evaluation, comprehensively calculating the evaluation results of force accuracy and pressure coping ability to obtain the evaluation score of pressure-related operations, and giving the corresponding evaluation level according to the score.

[0035] Furthermore, S1: Data acquisition: Use pressure sensors to collect the operation force data of the surgical instrument, the pressure distribution data of the key parts of the human body model, and the pressure data in the surgical simulation scenario; at the same time, collect the surgical environment data, the doctor's surgical video data, the operating room personnel information data, and the trainee's operation data;

[0036] S2: Pressure data analysis: Preprocess the collected pressure data to remove noise interference; adopt the finite element analysis algorithm, divide the surgical operation area of the human body model into multiple tiny units, establish a pressure distribution model, and calculate the pressure gradient and stress distribution of each unit; use the threshold judgment method to set the normal pressure range threshold and mark the pressure abnormal areas;

[0037] S3: Simulation Training: In a virtual reality environment, the trainee operates surgical instruments through a force acquisition module and conducts surgical simulation training on a human model module. The system collects the force data of the trainee's operation and the pressure feedback data of the human model in real time.

[0038] S4: Pressure-related Evaluation: According to the pressure evaluation model, quantitatively evaluate the trainee's force accuracy and pressure coping ability during simulation training. Calculate the force error rate and evaluate the trainee's coping performance under abnormal pressure conditions.

[0039] S5: Comprehensive Evaluation and Warning: Integrate the pressure evaluation results and other operation evaluation results to generate a multi-dimensional evaluation report. The system automatically identifies abnormal data related to pressure and triggers a warning.

[0040] S6: Result Output: Output the evaluation report and pressure-related data in various ways for the trainee and the instructor to view and analyze.

[0041] Advantages of the present invention:

[0042] A surgical training system and method based on virtual reality disclosed by the present invention can comprehensively collect various data such as surgical instruments, surgical environment, doctor's surgical video, operating room personnel, and trainee's operation through a data acquisition module including multiple sub-modules. It can also collect data on the operation force of surgical instruments, the pressure of the surgical simulation scene, and the pressure distribution of the human model operation by means of pressure sensors, providing rich and accurate basic information for subsequent training and analysis. The simulation training module provides a variety of surgical scenarios and training modes, randomly generates training questions and emergencies, and combines real-time operation feedback to create an experience close to real surgery, meeting the needs of trainees at different learning stages and improving the trainees' operation skills, clinical thinking, and emergency handling abilities. The evaluation module quantitatively evaluates the trainee's operation accuracy, operation speed, teamwork ability, and pressure-related operations and other aspects according to the evaluation standard library, avoiding the one-sidedness of subjective evaluation and providing clear and reliable evaluation results for trainees and instructors. The instructor assistance module provides functions such as real-time monitoring, annotation, personalized teaching plan formulation, teaching resource sharing, and teaching effect statistical analysis for the instructor, facilitating the teacher to observe the trainee's training situation, give guidance, optimize teaching strategies, and improve teaching quality. Brief Description of the Drawings

[0043] Figure 1 It is a flowchart of a surgical training system and method based on virtual reality in an embodiment of the present application.

[0044] Figure 2 It is another flowchart of a surgical training system and method based on virtual reality in an embodiment of the present application.

[0045] Figure 3 Another flowchart of a virtual reality-based surgical training system and its method in the embodiments of the present application.

[0046] Figure 4 A solution flowchart of a virtual reality-based surgical training system and its method in the embodiments of the present application. Specific embodiments

[0047] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the specific embodiments of the present invention will be clearly and completely described below.

[0048] The present invention discloses a virtual reality-based surgical training system and its method as Figure 1 shown, which includes a data acquisition module for acquiring surgical-related data. A data processing and modeling module, connected to the data acquisition module, for processing the acquired data. A simulation training module, connected to the data processing and modeling module, for trainees to perform surgical simulation training. An evaluation module, connected to the simulation training module and the data processing and modeling module. A teaching assistant module: connected to the simulation training module and the evaluation module, providing auxiliary functions for the teaching teacher. A system management module: for managing the surgical training system, including user account management, data security management, system settings, and model update management.

[0049] The data acquisition module is used to acquire surgical-related data. The data acquisition module can acquire surgical-related data, providing basic information for subsequent training and analysis. The data processing and modeling module is connected to the data acquisition module and is used to process the acquired data. When constructing the simulation model, the data processing and modeling module also considers the special requirements and risk factors of different surgeries, sets corresponding risk prompts and response measure training contents in the simulation model. For the cardiac surgery simulation model, cardiac arrest and massive hemorrhage risk scenarios are set, and corresponding first aid operation simulation training is provided. In the evaluation standard library, corresponding risk response evaluation indicators are formulated for the risk factors of different surgeries, including the timeliness of risk identification and the correctness of response measures.

[0050] The simulation training module is connected to the data processing and modeling module and is used for trainees to conduct surgical simulation training. The simulation training module provides a virtual surgical training environment for trainees. Trainees can practice various surgical operations in the virtual environment without worrying about causing harm to real patients. This enables trainees to practice repeatedly without risk and improve the proficiency of their surgical skills. Based on virtual reality technology, it can create a realistic surgical scene, including the operating feel of surgical instruments, the texture and reaction of tissues, etc., allowing trainees to obtain an experience close to real surgery and helping trainees better adapt to various situations in actual surgery. The simulation training module supports multiple trainees to participate in the same virtual surgical simulation training simultaneously in the team collaboration training mode, simulating different roles in the surgical team, including the surgeon, assistant doctor, nurse, and anesthesiologist. The system assigns corresponding tasks and operation permissions to each trainee according to the responsibilities and operation procedures of different roles. Trainees need to communicate and cooperate in real time through virtual communication tools. During the training process, the system simulates various surgical emergencies, including abnormal patient vital signs and surgical instrument failures, to test the trainees' team collaboration ability and emergency handling ability.

[0051] The evaluation module is connected to the simulation training module and the data processing and modeling module. The evaluation module can conduct a comprehensive and objective evaluation based on the operation data of trainees in the simulation training. The evaluation methods of the evaluation module include operation accuracy evaluation, which judges whether the instruments selected and the operation steps performed by trainees in the surgical simulation training meet the specifications and requirements, and calculates the proportion of correct operations. Operation speed evaluation, which records the time taken by trainees to complete various operation tasks and compares it with the standard time to evaluate the speed of operation. Team collaboration ability evaluation, which evaluates the communication and cooperation between trainees and other virtual or real trainees in the team collaboration training mode, including the timeliness of instrument transfer and the response speed to team instructions. Comprehensive evaluation, which comprehensively calculates the evaluation results of operation accuracy, operation speed, and team collaboration ability to obtain the final evaluation score and gives the corresponding evaluation level according to the score.

[0052] The teaching assistant module is connected to the simulation training module and the evaluation module, providing auxiliary functions for teaching teachers. Teachers can conveniently observe the training situation of students through the teaching assistant module and conduct guidance and teaching for students. The functions provided by the teaching assistant module include real-time monitoring function. Through this function, teaching teachers can view the operation pictures, operation steps and feedback information given by the system of students in the simulation training in real time. The functions provided by the teaching assistant module include annotation function. Teaching teachers can add text annotations during the training process of students or on the evaluation report, point out the advantages and disadvantages of students, and give improvement suggestions. The functions provided by the teaching assistant module include personalized teaching plan formulation function. According to the evaluation report and personal characteristics of students, teaching teachers formulate personalized teaching plans in the system, adjust the subsequent training content and difficulty. The functions provided by the teaching assistant module include teaching resource sharing function. Teaching teachers can upload and share teaching materials and case analysis resources related to surgery in the system for students to learn and reference. The teaching assistant module also has the function of statistical analysis of teaching effects. The system regularly collects the evaluation reports and training data of students and conducts statistical analysis on the teaching effects. The analysis content includes the learning progress of different students, the effectiveness of different teaching methods, and the mastery of different surgical scenario trainings. According to the statistical analysis results, teaching teachers can adjust teaching strategies and methods, optimize teaching content and training arrangements, and improve teaching quality.

[0053] The system management module is used to manage the surgical training system, including user account management, data security management, system settings, and model update management. The system management module is responsible for user account management and can conveniently manage the accounts of students, teaching teachers and other users, including account creation, login, permission setting, etc., to ensure the safe and standardized use of the system. The user account management function of the system management module includes user registration, login verification, and permission management. Different user roles such as students, teaching teachers, and system administrators have different operation permissions. The system management module includes a data security management function, which uses data encryption technology to encrypt and store and transmit various types of data in the system to prevent data leakage and tampering. The system settings function can set the display effect, sound prompt, and operation sensitivity parameters of the system. The system management module includes a model update management function. When new surgical techniques, equipment or clinical experiences appear, the system administrator can use this function to update and optimize the surgical instrument model, surgical environment model, and simulation training model. The system management module also includes a data backup and recovery function, which regularly backs up important data in the system, and the backup data is stored in a secure storage device. When the system fails or data is lost, the backup data can be restored to the system through the data recovery function to ensure the normal operation of the system and the integrity of the data. The data backup and recovery function supports two methods: full backup and incremental backup, and the appropriate backup strategy can be selected according to actual needs.

[0054] As an implementation manner, the data acquisition module includes a surgical instrument information acquisition sub-module for acquiring data on the model, appearance, function, and usage method of surgical instruments; a surgical environment information acquisition sub-module for acquiring environmental data on the layout of the operating room, equipment placement, and lighting conditions; a surgical video acquisition sub-module for collecting surgical video materials of different doctors; an operating room personnel information acquisition sub-module for inputting data on the basic information, professional skills, and surgical experience of doctors, nurses, and anesthesiologists in the operating room; and a trainee operation acquisition sub-module for recording the operation behaviors, operation times, and operation result data of trainees during the simulation training process.

[0055] The surgical instrument information acquisition sub-module acquires data on the model, appearance, function, and usage method of surgical instruments. Trainees can understand the subtle differences between different models of instruments, so as to use the instruments more precisely in simulated surgeries and improve the proficiency of operations. Surgical instruments in the medical field are constantly updated and there is a wide variety of them. Mastering rich instrument data helps trainees quickly become familiar with and start operating on instruments in different surgical scenarios in the future. Accurate instrument data can be used to construct a more realistic virtual surgical instrument model, presenting the operation feel and feedback of real instruments in simulation training and enhancing the authenticity of the training.

[0056] The surgical environment information acquisition sub-module is used to acquire environmental data such as the layout of the operating room, equipment placement, and lighting conditions, and can highly restore the real operating room scene in the virtual environment. Trainees can adapt to the spatial layout and equipment positions in the operating room in advance when training in such an environment. Understanding the layout of the operating room helps trainees develop spatial perception ability and can plan the operation path more reasonably in simulated surgeries, avoiding operation errors or inefficiencies caused by incorrect spatial judgments.

[0057] The surgical video acquisition sub-module collects surgical video materials of different doctors. Trainees can observe and learn the surgical skills, operation procedures, and strategies for dealing with various situations of experienced doctors. Different doctors may have different surgical styles and ways of handling problems. Trainees' exposure to diverse surgical videos helps broaden their surgical horizons and learn more methods and ideas for solving common problems in surgeries.

[0058] The operating room personnel information acquisition sub-module is used to input data on the basic information, professional skills, and surgical experience of doctors, nurses, and anesthesiologists in the operating room, which helps to reasonably arrange team roles in simulation training and simulate real team collaboration scenarios. Trainees can better understand the responsibilities and skill characteristics of different roles.

[0059] The trainee operation collection sub-module records the operation behaviors, operation times, and operation result data of trainees during the simulation training process, and can accurately analyze the training performance of trainees. Through detailed data statistics and analysis, the proficiency, operation speed, and final training effect of trainees in each operation link can be understood, providing an objective basis for evaluating the learning progress and ability of trainees. According to the collected operation data of trainees, the teaching teacher can provide personalized learning guidance according to the characteristics and problems of each trainee. As Figure 2 shown in Figure 2 Figure 4 is a flowchart of a virtual reality-based surgical training system and its method.

[0060] As an implementation method, the data processing and modeling module processes the collected data, including sorting out the surgical instrument data and surgical environment data, constructing a surgical instrument model and a surgical environment model. Analyze the doctor's surgical video data, extract information such as the doctor's surgical habits, instrument usage methods, and key points of intraoperative cooperation, and establish an operating room personnel database. According to the surgical procedures and specifications, construct a preoperative instrument preparation simulation model, a general simulation model for intraoperative cooperation with doctors, a specific simulation model for intraoperative cooperation with specific doctors, and establish an evaluation standard library based on the operation data of trainees. The evaluation module quantitatively evaluates the operation accuracy, operation speed, and teamwork ability of trainees in the simulation training according to the evaluation standard library, and generates an evaluation report. According to the evaluation standard library, quantitatively evaluating the operation accuracy, operation speed, teamwork ability, etc. of trainees in the simulation training can clearly and accurately reflect the ability levels of trainees in various aspects. The quantitative evaluation method avoids the one-sidedness and ambiguity of subjective evaluation, making the evaluation results more credible and persuasive. The data processing and modeling module constructs a general model according to general surgeries for training regular basic operations. The data processing and modeling module constructs a specific simulation model for intraoperative cooperation with specific doctors. According to the surgical habits and preferences of each doctor, set specific instrument usage sequences and instruction methods, and construct an exclusive simulation scenario for training some special techniques and skills of specific doctors. In the data processing and modeling module, the construction of the surgical instrument model analyzes the surgical instrument data and uses 3D modeling technology to construct a 3D model of the surgical instrument. The model includes the appearance, structure, and details of operable parts of the instrument, and can simulate the actual usage actions and effects of the instrument. When constructing the surgical environment model, according to the surgical environment data, create a virtual operating room environment including the operating table, medical equipment, and drug storage areas. The environment model has a real spatial layout and lighting effects. When establishing the operating room personnel database, classify, sort out, and store the collected operating room personnel information for convenient subsequent calling and analysis. Construct a preoperative instrument preparation simulation model, set correct instrument selection and placement rules according to the requirements of different surgical types, and simulate the preoperative instrument preparation process. Construct a general simulation model for intraoperative cooperation with doctors, analyze the cooperation modes between doctors and nurses in a large number of surgical cases, extract general cooperation key points and processes, and construct a simulation scenario.

[0061] As an implementation manner, the simulation training module further includes a scenario selection sub-module, which is used to select different types of surgical scenarios for training, including surgeries in different departments and surgeries with different difficulty levels. A training mode selection sub-module that provides a single-person training mode and a team collaboration training mode. A random question generation sub-module that is used to randomly generate training questions, randomly specify the required instruments, and randomly generate unexpected surgical situations according to the currently selected surgical scenario and training content. An operation feedback sub-module that monitors the operation behavior of the trainee in real time, compares it with the preset correct operation, gives positive feedback for correct operations, and gives error prompts and corrective suggestions for incorrect operations. The scenario selection sub-module provides diverse training content and can select different types of surgical scenarios for training, covering surgeries in different departments and surgeries with different difficulty levels. Surgical scenarios with different difficulty levels meet the needs of trainees at different learning stages. Surgical scenarios covering multiple departments enable trainees to better adapt to various situations that may be encountered in actual clinical work. In the actual hospital environment, doctors may need to participate in surgical collaborations in different departments. Through diverse surgical scenario training, trainees can become familiar with the processes and characteristics of different types of surgeries in advance and improve their ability to handle actual work.

[0062] The training mode selection sub-module cultivates personal skills. The single-person training mode allows trainees to focus on the training of their own operation skills without being interfered by others. The team collaboration training mode simulates the scenario of multi-role collaborative work in actual surgeries. Trainees need to cooperate with other team members, either virtually or in person, to complete the surgical tasks together. The random question generation sub-module randomly generates training questions, specifies the required instruments, and generates unexpected surgical situations according to the currently selected surgical scenario and training content, making each training full of uncertainties. In actual surgeries, various unexpected situations and emergencies often occur. The setting of randomly generating unexpected surgical situations can more realistically simulate the actual surgical scenario. Trainees need to learn to handle these emergencies during training, cultivate the ability to make correct decisions and respond quickly in complex situations, and improve their clinical thinking and emergency handling abilities. The operation feedback sub-module promptly corrects incorrect operations, monitors the operation behavior of trainees in real time, compares it with the preset correct operation, and gives error prompts and corrective suggestions in a timely manner when the operation is incorrect. This enables trainees to discover and correct their mistakes immediately, avoid the repetition and solidification of incorrect operations, and improve learning efficiency and operation accuracy.

[0063] As an implementation manner, the data acquisition module is used to acquire the operation force data of surgical instruments, the pressure data in the surgical simulation scenario, and the pressure distribution data when the trainee operates on the human model. The data acquisition module includes a number of pressure sensors. The data processing and modeling module: processes and analyzes the acquired pressure data, establishes a pressure evaluation model, and processes the pressure data using the finite element analysis algorithm. The simulation training module includes a force acquisition module and a human model module. The force acquisition module is used to acquire the force data of the trainee operating the surgical instruments in real time. The human model module simulates the pressure feedback and mechanical characteristics of different parts of the human body. The force acquisition module is connected to the operation feedback sub-module. The evaluation module: The evaluation module is connected to the simulation training module and the data processing and modeling module. According to the pressure evaluation model, it quantitatively evaluates the operation accuracy, force control, and pressure response ability of the trainee in the simulation training, generates an evaluation report, and the evaluation report includes index analysis and improvement suggestions.

[0064] The data acquisition module uses a number of pressure sensors to acquire the operation force data of surgical instruments, the pressure data in the surgical simulation scenario, and the pressure distribution data when the trainee operates on the human model, and can accurately capture the key information related to pressure in the surgical operation process. In real surgery, the operation force of surgical instruments, the pressure change of the surgical site, etc. have an important impact on the surgical effect. Collecting pressure data can make the simulation training closer to the actual surgical scenario, enabling trainees to better adapt to and master the pressure factors in real surgery during the training process.

[0065] The data processing and modeling module processes and analyzes the collected pressure data, establishes a pressure assessment model, and uses the finite element analysis algorithm for processing, which can deeply explore the laws and characteristics behind the pressure data. The pressure assessment model provides a scientific standard and basis for subsequent assessment of trainees' operations, making the assessment more objective and accurate. The finite element analysis algorithm can simulate the mechanical responses of human tissues and surgical instruments under different pressure conditions, helping trainees and instructors predict the possible consequences of surgical operations, thereby optimizing the surgical operation plan and improving the safety and success rate of the surgery. The force acquisition module of the simulation training module real-time collects the force data when trainees operate surgical instruments and connects it to the operation feedback sub-module. This enables trainees to obtain timely feedback on force control during the operation and understand whether their operations meet the requirements. Through continuous adjustment and training, trainees can gradually improve their force control ability and avoid harming patients due to improper force application. The human body model module simulates the pressure feedback and mechanical characteristics of different parts of the human body, allowing trainees to feel the pressure changes and mechanical responses similar to those of the real human body when operating the human body model. This realistic simulation experience helps trainees better understand the impact of surgical operations on human tissues and improve the accuracy and proficiency of operations. The assessment module quantitatively assesses trainees' operation accuracy, force control, and pressure response ability during simulation training according to the pressure assessment model, and can comprehensively and objectively reflect trainees' ability to handle pressure factors during surgical operations. The quantitative assessment results enable trainees and instructors to clearly understand the strengths and weaknesses of trainees and provide a clear direction for further learning and guidance.

[0066] As an implementation method, the force acquisition module uses the pressure measurement sub-unit to collect the human body pressure data in the area of the human body model module. The finite element analysis algorithm is used to process the human body pressure data. The area of the human body model module is divided into multiple tiny units, each unit corresponding to a pressure sensor data point. By establishing a human body pressure distribution model, the human body pressure gradient and stress distribution of the entire area are calculated based on the pressure values of each point. Pressure sensors are arranged at key parts of the human body model, such as around the surgical incision and the visceral simulation area, to collect the pressure change data of the corresponding parts of the human body model when trainees operate. Pressure sensors are installed on relevant equipment in the surgical simulation scenario, such as the operating table and the fixing device, to collect the pressure data in the scenario.

[0067] Use the threshold judgment method to judge the human pressure of the force acquisition module, set the threshold of the normal human pressure range, and when the pressure in a certain area is detected to exceed the threshold range, it is determined that the pressure in this area is abnormal. Mark the pressure abnormal area that exceeds the normal upper limit by 10% for more than 5 seconds, and prompt that there is an abnormality in the surgical force exceeding the standard. The force acquisition module uses the pressure measurement subunit to collect the human pressure data in the human model module area, and can accurately and comprehensively obtain the pressure change of the human model during the surgical simulation operation. In this way, any pressure change applied by the trainee during the operation can be accurately recorded, providing an accurate data basis for subsequent analysis and evaluation. By collecting the pressure data in the human model area, the simulation training is more in line with the pressure response of the real human body during the operation. The trainee can feel the pressure feedback similar to the actual operation during the training, so as to better adapt to and master the operation skills in the real surgical scenario. Use the finite element analysis algorithm to process the human pressure data, divide the human model module area into multiple tiny units, each unit corresponds to a pressure sensor data point, and then establish a human pressure distribution model. This method can deeply analyze the pressure gradient and stress distribution of the human model during the surgical operation. The trainee and the instructor can clearly understand the pressure change law of different parts during the operation, which helps the trainee optimize the operation actions and avoid damaging human tissues due to excessive local pressure. The finite element analysis algorithm can scientifically quantify the complex human pressure situation and convert the continuous pressure distribution into specific data points and models. This not only facilitates the storage and analysis of pressure data, but also provides a reliable basis for subsequent evaluation and decision-making. Use the threshold judgment method to judge the human pressure of the force acquisition module, and set the threshold of the normal human pressure range. Once the pressure in a certain area is detected to exceed the threshold range, it is determined that the pressure in this area is abnormal. The real-time monitoring and judgment mechanism can timely detect possible problems of the trainee during the operation, such as excessive force or improper operation, so that the trainee can adjust the operation method in time to avoid the continuation and accumulation of wrong operations.

[0068] As an implementation method, the pressure data acquisition in the data acquisition module includes setting pressure sensors on the surgical instruments, collecting the instrument pressure data applied by the trainee when operating the instruments, and comparing the instrument pressure data with the human pressure data tested by the pressure measurement subunit. When the pressure difference between the instrument pressure data and the human pressure data is less than or equal to 12%, the actual pressure is the average value between the instrument pressure data and the human pressure data. When the pressure difference between the instrument pressure data and the human pressure data is greater than 12%, the pressure abnormality is displayed.

[0069] A pressure sensor is set on the surgical instrument to collect the instrument pressure data. At the same time, the human body pressure data is tested through the pressure measurement subunit. By combining and comparing the two, it can more comprehensively and accurately reflect the actual pressure applied by the trainee when operating the surgical instrument. Because during the surgical process, there is a correlation between the instrument pressure and the pressure borne by the human body. Comparing the data of the two can avoid the errors that may occur from a single data source, thus more accurately simulating the pressure changes in the real surgical scenario. When the pressure gap between the instrument pressure data and the human body pressure data is greater than 12%, a pressure anomaly is displayed. This mechanism can timely detect the possible problems during the trainee's operation. If the instrument pressure is too high while the human body pressure does not increase correspondingly, it may mean that the instrument is used improperly or there is an abnormality in the feedback mechanism of the human body model. And if the human body pressure is too high while the instrument pressure is relatively low, it may indicate that there is a fault in the human body model or the trainee's operation method causes unreasonable pressure on the human body. Timely detecting these anomalies can avoid potential risks and ensure the safe progress of the simulation training. When the pressure gap between the instrument pressure data and the human body pressure data is less than or equal to 12%, the average value of the two is taken as the actual pressure. The pressure data obtained in this way is more reasonable and reliable, can provide a more accurate input for the subsequent pressure assessment model, and thus make the assessment result better reflect the trainee's real operation level.

[0070] As an implementation method, for the assessment of pressure-related operations by the assessment module, the force accuracy assessment is used to judge whether the force applied by the trainee when operating the surgical instrument conforms to the surgical operation specifications and requirements, and calculate the force error rate. The pressure coping ability assessment sets pressure anomaly situations during the simulated surgical process to evaluate the trainee's coping ability to pressure changes, including whether they can timely adjust the operation force and take correct coping measures. The comprehensive pressure assessment comprehensively calculates the assessment results of force accuracy and pressure coping ability to obtain the assessment score of pressure-related operations, and gives the corresponding assessment level according to the score.

[0071] By judging whether the force exerted by the trainee when operating the surgical instrument conforms to the surgical operation specifications and requirements, and calculating the force error rate, the trainee can clearly understand the gap between their own force control and the standard. In real surgery, precise force control has a great impact. For example, excessive force during suturing may tear the tissue, while too little force may result in insecure suturing. This evaluation method helps trainees develop the habit of standardized operation and improve the accuracy of surgical operation. The calculation of the force error rate provides a quantitative index for the trainee's force control ability. The instructor can clearly understand the operation level of the trainee based on this index, objectively compare different trainees, and also track the progress of trainees at different stages, providing a basis for teaching adjustment. During the simulated surgical process, set abnormal pressure situations to evaluate the trainee's ability to respond to pressure changes, which highly simulates the sudden situations that may occur in real surgery. In actual surgery, various factors may cause abnormal pressure, such as tissue adhesion, changes in the patient's physical condition, etc. Evaluating whether the trainee can promptly adjust the operation force and take correct countermeasures helps cultivate the trainee's emergency handling ability and clinical thinking. When facing abnormal pressure, the trainee needs to quickly judge the situation and make the right decision, which can ensure the smooth progress of the surgery and the safety of the patient. By comprehensively calculating the evaluation results of force accuracy and pressure response ability, obtaining the evaluation score for pressure-related operations, and giving the corresponding evaluation grade according to the score, the comprehensive ability of the trainee in pressure-related operations can be evaluated comprehensively and objectively. The comprehensive evaluation can more comprehensively display the advantages and disadvantages of the trainee, providing the trainee with a more accurate self-awareness.

[0072] For example Figure 3 As shown in Figure 3 , a virtual reality-based surgical training system and its method include: S1: Data collection; S2: Pressure data analysis; S3: Simulation training; S4: Pressure-related evaluation; S5: Comprehensive evaluation and early warning; S6: Result output.

[0073] For example Figure 4 As shown in Figure 4 , as an implementation method, data collection: Use the data collection module to collect surgical instrument pictures and doctor's surgical videos, comprehensively collect surgical-related data, and provide a rich information source for subsequent processing and analysis.

[0074] Data processing: With the help of the data processing and modeling module, classify the collected surgical instrument pictures according to the instrument package for standby; process the doctor's surgical videos, classify them according to the operator and surgical procedure, and analyze to find out the commonalities and characteristics, laying a foundation for establishing a training model.

[0075] Establish a preoperative instrument preparation model: According to the surgical procedure name, find out the required instruments through the analyzed and processed data, and use the simulation training module for targeted training to let trainees be familiar with the preoperative instrument preparation process.

[0076] Establish a general intraoperative cooperation model: Extract commonalities from doctors' surgical videos. According to the evaluation criteria of the evaluation module, for specific surgical procedures, carry out guiding training in the simulation training module to improve the basic intraoperative cooperation ability of trainees.

[0077] Establish a targeted intraoperative cooperation model: Based on the special habits of surgeons summarized from data processing, combined with the teaching assistant module, formulate personalized training plans for trainees and conduct targeted training to enhance the cooperation degree between trainees and specific surgeons.

[0078] Use and collect data: Conduct small-scale trials of the completed various models in the simulation training module, and use the data collection module to collect the operation data of trainees during the training process, including operation accuracy, speed, teamwork and other related data.

[0079] Process data and summarize: Use the data processing and modeling module to process the collected data, combine with the evaluation module to give evaluation results, summarize the training effect, further optimize the model, and continuously improve the quality and effect of the surgical training system.

[0080] It should be understood that for those of ordinary skill in the art, improvements or transformations can be made according to the above description, and all such improvements and transformations should fall within the protection scope of the appended claims of the present invention.

Claims

1. A virtual reality-based surgical training system, characterized in that, Including: Data acquisition module: used to acquire surgical-related data; Data processing and modeling module: connected to the data acquisition module, used to process the acquired data; Simulation training module: connected to the data processing and modeling module, used for trainees to conduct surgical simulation training; Evaluation module: connected to the simulation training module and the data processing and modeling module; Teaching assistant module: connected to the simulation training module and the evaluation module, providing auxiliary functions for teaching teachers; System management module: used to manage the surgical training system, including user account management, data security management, system settings, and model update management.

2. The surgical training system based on virtual reality according to claim 1, characterized in that: The data acquisition module includes: Surgical instrument information acquisition sub-module, used to acquire data on the model, appearance, function, and usage method of surgical instruments; Surgical environment information acquisition sub-module, used to acquire environmental data on the layout of the operating room, equipment placement, and lighting conditions; Surgical video acquisition sub-module, used to collect surgical video materials of different doctors; Operating room personnel information acquisition sub-module, used to enter basic information, professional skills, and surgical experience data of doctors, nurses, and anesthesiologists in the operating room; Trainee operation acquisition sub-module, used to record the operation behavior, operation time, and operation result data of trainees during the simulation training process.

3. The surgical training system based on virtual reality according to claim 2, characterized in that: The data processed by the data processing and modeling module includes: Sorting out surgical instrument data and surgical environment data, and constructing a surgical instrument model and a surgical environment model; Analyzing the doctor's surgical video data, extracting information on the doctor's surgical habits, instrument usage methods, and key points of intraoperative cooperation, and establishing an operating room personnel database; According to the surgical procedures and specifications, constructing a preoperative instrument preparation simulation model, a general simulation model for intraoperative cooperation with doctors, a specific simulation model for intraoperative cooperation with specific doctors, and establishing an evaluation standard library based on trainee operation data; The evaluation module quantitatively evaluates the operation accuracy, operation speed, and teamwork ability of trainees during the simulation training according to the evaluation standard library, and generates an evaluation report.

4. A virtual reality-based surgical training system according to claim 1, characterized in that: The simulation training module also includes: a scenario selection sub-module, which is used to select different types of surgical scenarios for training, including surgeries in different departments and surgeries of different difficulty levels; Training mode selection sub-module, providing a single-person training mode and a teamwork training mode; Random question generation sub-module, which is used to randomly generate training questions, randomly specify the required instruments, and randomly generate sudden surgical situations according to the currently selected surgical scenario and training content; Operation feedback sub-module, which monitors the operation behavior of trainees in real time, compares it with the preset correct operation, gives positive feedback for correct operations, and gives error prompts and corrective suggestions for incorrect operations.

5. The surgical training system based on virtual reality according to claim 1, wherein: Data acquisition module: used to acquire surgical instrument operation force data, pressure data in the surgical simulation scenario, and pressure distribution data when trainees operate on the human model. The data acquisition module includes several pressure sensors; Data processing and modeling module: processes and analyzes the acquired pressure data, establishes a pressure evaluation model, and processes the pressure data using the finite element analysis algorithm; Simulation training module: It includes a force acquisition module and a human body model module. The force acquisition module is used to collect the force data in real time when the trainee operates the surgical instrument, and the human body model module simulates the pressure feedback and mechanical properties of different parts of the human body; Evaluation module: The evaluation module is connected to the simulation training module and the data processing and modeling module. According to the pressure evaluation model, it quantitatively evaluates the operation accuracy, force control, and pressure response ability of the trainee during the simulation training, generates an evaluation report, and the evaluation report includes index analysis and improvement suggestions.

6. The surgical training system based on virtual reality according to claim 5, wherein: The force acquisition module uses a pressure measurement subunit to collect the human body pressure data in the area of the human body model module; The force acquisition module processes the human body pressure data using the finite element analysis algorithm, divides the area of the human body model module into multiple tiny units, each unit corresponds to a pressure sensor data point, establishes a human body pressure distribution model, and calculates the human body pressure gradient and stress distribution of the entire area according to the pressure values of each point; Use the threshold judgment method to judge the human body pressure of the force acquisition module, set the threshold range of the normal human body pressure, and when the pressure in a certain area is detected to exceed the threshold range, it is determined that the pressure in this area is abnormal; Mark the pressure abnormal area that exceeds the normal upper limit by 10% for more than 5 seconds, and prompt that there is an abnormality in the surgical force exceeding the standard.

7. The surgical training system based on virtual reality according to claim 6, wherein: The pressure data acquisition in the data acquisition module includes several pressure sensors set on the surgical instrument, collects the instrument pressure data applied when the trainee operates the instrument, and compares the instrument pressure data with the human body pressure data tested by the pressure measurement subunit. When the pressure difference between the instrument pressure data and the human body pressure data is less than or equal to 12%, the actual pressure is the average value between the instrument pressure data and the human body pressure data. When the pressure difference between the instrument pressure data and the human body pressure data is greater than 12%, it indicates that the pressure is abnormal.

8. The surgical training system based on virtual reality according to claim 7, characterized in that: The evaluation of the pressure-related operations by the evaluation module: Force accuracy evaluation, judge whether the force applied by the trainee when operating the surgical instrument meets the surgical operation specifications and requirements, and calculate the force error rate; Pressure response ability evaluation, set abnormal pressure situations during the simulated surgical process, and evaluate the trainee's ability to respond to pressure changes, including whether they can adjust the operation force in time and take correct response measures; Comprehensive pressure evaluation, comprehensively calculate the evaluation results of force accuracy and pressure response ability, obtain the evaluation score of the pressure-related operations, and give the corresponding evaluation level according to the score.

9. A surgical training method based on virtual reality, characterized in that Operated by the virtual reality-based surgical training system in claims 1-8, including: S1: Data acquisition: Use pressure sensors to collect the operation force data of the surgical instrument, the pressure distribution data of the key parts of the human body model, and the pressure data in the surgical simulation scenario; at the same time, collect the surgical environment data, the doctor's surgical video data, the operating room personnel information data, and the trainee's operation data; S2: Pressure data analysis: Preprocess the collected pressure data to remove noise interference; use the finite element analysis algorithm to divide the surgical operation area of the human model into multiple tiny units, establish a pressure distribution model, and calculate the pressure gradient and stress distribution of each unit; use the threshold judgment method to set the threshold of the normal pressure range and mark the pressure abnormal areas; S3: Simulation training: The trainee operates the surgical instrument through the force acquisition module in the virtual reality environment and conducts surgical simulation training on the human model module; the system collects the force data of the trainee's operation and the pressure feedback data of the human model in real time; S4: Pressure-related evaluation: According to the pressure evaluation model, quantitatively evaluate the trainee's force accuracy and pressure coping ability in the simulation training; calculate the force error rate and evaluate the trainee's coping performance under abnormal pressure conditions; S5: Comprehensive evaluation and early warning: Integrate the pressure evaluation results and other operation evaluation results to generate a multi-dimensional evaluation report; the system automatically identifies the abnormal data related to pressure and triggers an early warning; S6: Result output: Output the evaluation report and pressure-related data in various ways for the trainee and the instructor to view and analyze.

Images