Virtual medical training method and terminal

Abstract

This invention discloses a virtual medical training method and terminal. Based on historical medical case data, a virtual surgical model and a virtual surgical scenario are created. Using an AR device worn by the trainee, the virtual surgical model and scenario are projected onto the trainee's real-world environment. The method monitors the simulated surgical operations performed by the trainee on the virtual surgical model using the AR device and provides feedback on the evaluation results of the simulated surgical operations. This invention, based on historical medical case data, creates virtual surgical models and scenarios, and then projects them onto the trainee's real-world environment, guiding the trainee to immerse themselves in a realistic surgical experience and perform surgical operations on the virtual surgical model. This simulates real medical scenarios, achieves medical surgical simulation, connects medical knowledge with actual surgical operations, enhances the interactivity of the training process, and improves the efficiency of practical application of medical knowledge.

Description

Technical Field

[0001] This invention relates to the field of medical education technology, and in particular to a virtual medical training method and terminal. Background Technology

[0002] In recent years, with the continuous advancement of medical technology and the increasing demand for healthcare, the importance of medical education and training has become increasingly prominent. However, traditional medical education and training methods mainly rely on classroom teaching and clinical internships, which have many inconveniences such as time and space limitations, limited resources, and insufficient personalization.

[0003] Therefore, existing virtual reality (VR) technology is gradually being introduced into the field of medical education and training. VR technology can create immersive virtual environments. However, the current application of virtual technology is limited to simulating medical rescue scenarios and medical teaching classrooms, providing students with an immersive observation experience. But this approach lacks interactivity, is not flexible enough, and makes it difficult for trainees to connect medical knowledge with practical operations, resulting in a very low efficiency in the practical application of medical knowledge. Summary of the Invention The technical problem to be solved by this invention is to provide a virtual medical training method and terminal, which enhances the interactivity of the training process and improves the efficiency of practical application of medical knowledge.

[0004] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows: A virtual medical training method includes the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee.

[0005] To solve the above-mentioned technical problems, another technical solution adopted by the present invention is as follows: A virtual medical training terminal includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor runs the computer program, it performs the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee. The beneficial effects of this invention are as follows: It provides a virtual medical training method and terminal, which creates virtual surgical models and virtual surgical scenarios based on historical medical case data, and then projects the virtual surgical models and virtual surgical scenarios into the real environment in which the trainees are located, guiding the trainees to immerse themselves in the real surgical scene and perform surgical operations on the virtual surgical model, simulating real medical scenarios, realizing medical surgical simulation, connecting medical knowledge with actual surgical operations, enhancing the interactivity of the training process, and improving the efficiency of practical transformation of medical knowledge. Attached Figure Description

[0006] Figure 1 This is a schematic diagram illustrating the steps of a virtual medical training method according to an embodiment of the present invention; Figure 2 This is a system block diagram of a virtual medical training terminal according to an embodiment of the present invention.

[0007] Label Explanation: 1. A virtual medical training terminal; 2. A memory; 3. A processor. Detailed Implementation

[0008] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0009] Please refer to Figure 1 A virtual medical training method includes the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee. As can be seen from the above description, the beneficial effects of the present invention are as follows: based on historical medical case data, a virtual surgical model and a virtual surgical scene are created, and then the virtual surgical model and the virtual surgical scene are projected onto the real environment in which the trainees are located, guiding the trainees to immerse themselves in the real surgical scene and perform surgical operations on the virtual surgical model, simulating real medical scenes, realizing medical surgical simulation, connecting medical knowledge with actual surgical operations, strengthening the interactivity of the training process, and improving the efficiency of practical transformation of medical knowledge.

[0010] Further, S1 includes: S11. Analyze the surgical steps and operation details from the surgical videos of historical medical case data, and configure the interactive elements of the virtual surgical model according to the surgical steps and operation details. S12. Generate a virtual surgical scene based on the patient's medical history and surgical records from historical medical case data.

[0011] As described above, multi-dimensional analysis of historical medical case data allows for a deep reconstruction of the complexity and diversity of real surgical scenarios. Surgical steps and operational details are extracted from surgical videos, and interactive elements are precisely configured for virtual surgical models. This enables trainees to experience various operational situations that might occur in real surgery, such as the force of tissue separation and the angle of instrument use, thereby strengthening their training in standardized procedures. Virtual surgical scenarios are generated based on patient medical history and surgical records, simulating surgical conditions under different illnesses and physical conditions, such as the management of complex complications and the handling of anesthesia risks for patients with special physical conditions. This allows trainees to accumulate diverse clinical experience during the training phase.

[0012] Furthermore, S1 also includes: Based on patient age, medical history, and disease type from historical medical case data, virtual surgical models and virtual surgical scenarios of different difficulty levels are created; Generate a course list containing all the virtual surgical models and the virtual surgical scenarios.

[0013] As described above, creating virtual surgical models and scenarios of varying difficulty levels based on patient age, medical history, and disease type from historical medical case data can fully meet the personalized learning needs of trainees. Trainees with weak medical backgrounds can start with simple symptoms and basic procedures in low-difficulty scenarios, gradually mastering fundamental surgical skills. Experienced trainees, on the other hand, can further enhance their ability to handle complex clinical situations through high-difficulty scenarios, such as surgical management of elderly patients with complex conditions. This truly achieves individualized instruction and avoids the low learning efficiency caused by a "one-size-fits-all" approach to training.

[0014] Furthermore, the monitoring of the simulated surgical operations performed by the trainee on the virtual surgical model via the AR device also includes: A virtual tutor is created using an AR device, and the virtual tutor sends real-time guidance information to the student.

[0015] As can be seen from the above description, virtual instructors can provide accurate feedback to students immediately during their operations, promptly correcting errors in surgical procedures, instrument usage, and operating techniques, preventing students from developing incorrect operating habits, and greatly improving the immediacy and accuracy of learning.

[0016] Furthermore, it also includes: S4. Create a virtual classroom corresponding to the virtual surgical model, and send an invitation link to all students who have completed the same virtual surgical model to participate in the virtual classroom.

[0017] As described above, the virtual classroom provides students with a platform for centralized Q&A and knowledge expansion. It can systematically explain common problems encountered by students during operation, supplement cutting-edge medical knowledge and clinical cases, and maximize the integration and utilization of teaching resources.

[0018] Please refer to Figure 2 A virtual medical training terminal 1 includes a memory 2, a processor 3, and a computer program stored on the memory 2 and executable on the processor 3. When the processor 3 runs the computer program, it performs the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee. As can be seen from the above description, the beneficial effects of the present invention are as follows: based on historical medical case data, a virtual surgical model and a virtual surgical scene are created, and then the virtual surgical model and the virtual surgical scene are projected onto the real environment in which the trainees are located, guiding the trainees to immerse themselves in the real surgical scene and perform surgical operations on the virtual surgical model, simulating real medical scenes, realizing medical surgical simulation, connecting medical knowledge with actual surgical operations, strengthening the interactivity of the training process, and improving the efficiency of practical transformation of medical knowledge.

[0019] Further, S1 includes: S11. Analyze the surgical steps and operation details from the surgical videos of historical medical case data, and configure the interactive elements of the virtual surgical model according to the surgical steps and operation details. S12. Generate a virtual surgical scene based on the patient's medical history and surgical records from historical medical case data.

[0020] As described above, multi-dimensional analysis of historical medical case data can deeply recreate the complexity and diversity of real surgical scenarios. Extracting surgical steps and operational details from surgical videos allows for the precise configuration of interactive elements in virtual surgical models, enabling trainees to experience various operational scenarios that might occur in real surgery, such as the force of tissue separation and the angle of instrument use, thereby strengthening their training in standardized procedures. Generating virtual surgical scenarios based on patient medical history and surgical records can simulate surgical conditions under different illnesses and physical conditions, such as the management of complex complications and the handling of anesthesia risks for patients with special physical conditions, allowing trainees to accumulate diverse clinical experience during the training phase.

[0021] Furthermore, S1 also includes: Based on patient age, medical history, and disease type from historical medical case data, virtual surgical models and virtual surgical scenarios of different difficulty levels are created; Generate a course list containing all the virtual surgical models and the virtual surgical scenarios.

[0022] As described above, creating virtual surgical models and scenarios of varying difficulty levels based on patient age, medical history, and disease type from historical medical case data can fully meet the personalized learning needs of trainees. Trainees with weak medical backgrounds can start with simple symptoms and basic procedures in low-difficulty scenarios, gradually mastering fundamental surgical skills. Experienced trainees, on the other hand, can further enhance their ability to handle complex clinical situations through high-difficulty scenarios, such as surgical management of elderly patients with complex conditions. This truly achieves individualized instruction and avoids the low learning efficiency caused by a "one-size-fits-all" approach to training.

[0023] Furthermore, the monitoring of the simulated surgical operations performed by the trainee on the virtual surgical model via the AR device also includes: A virtual tutor is created using an AR device, and the virtual tutor sends real-time guidance information to the student.

[0024] As can be seen from the above description, virtual instructors can provide accurate feedback to students immediately during their operations, promptly correcting errors in surgical procedures, instrument usage, and operating techniques, preventing students from developing incorrect operating habits, and greatly improving the immediacy and accuracy of learning.

[0025] Furthermore, it also includes: S4. Create a virtual classroom corresponding to the virtual surgical model, and send an invitation link to all students who have completed the same virtual surgical model to participate in the virtual classroom.

[0026] As described above, the virtual classroom provides students with a platform for centralized Q&A and knowledge expansion. It can systematically explain common problems encountered by students during operation, supplement cutting-edge medical knowledge and clinical cases, and maximize the integration and utilization of teaching resources.

[0027] Please refer to Figure 1 Embodiment 1 of the present invention is as follows: A virtual medical training method includes the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; In this implementation, historical medical case data may include medical textbooks, surgical videos, case records, etc.; data formats include, but are not limited to, video, audio, images, and text. Artificial intelligence technology is used to analyze and process the collected data, including image recognition, speech recognition, and natural language processing. During data analysis, surgical steps and operational details are extracted from the surgical videos in the historical medical case data. Based on these steps and details, interactive elements of the virtual surgical model are configured. A virtual surgical scene is generated based on the patient's medical history and surgical records from the historical medical case data.

[0028] To meet the learning needs of students at different paces and levels, virtual surgical models and scenarios of varying difficulty are created based on patient age, medical history, and disease type data from historical medical case data. A course list containing all virtual surgical models and scenarios is then generated. During training, students select the appropriate virtual surgical model and scenario from the course list for their chosen training session.

[0029] For example, the course list allows students to operate and practice in a virtual environment using AR devices and gesture recognition technology; beginner courses include the diagnosis and treatment of common diseases, such as routine appendectomy; intermediate courses include complex surgeries, such as liver transplantation; and advanced courses include the diagnosis and treatment of rare diseases, such as surgical treatment of certain genetic diseases.

[0030] S2. Using AR devices worn by trainees, virtual surgical models and virtual surgical scenes are projected onto the trainees' real-world environment. In this embodiment, virtual surgical models and scenarios are presented to trainees using augmented reality (AR) technology. Trainees can interact and learn through AR devices such as AR glasses and smartphones. During learning, trainees can perform simulated surgical procedures in the virtual environment, with the system providing real-time operational guidance and feedback. Through AR devices, trainees can see virtual surgical scenes and instruments and practice simulated surgical steps. Trainees can also view virtual medical records and formulate diagnoses and treatment plans using AR devices. The system utilizes AI technology to analyze the trainees' diagnostic results and provides reference opinions and improvement suggestions.

[0031] Furthermore, virtual tutors can be created using AR devices, and these virtual tutors can send real-time guidance information to students. In addition, students can interact and communicate with virtual tutors or other students in real time.

[0032] S3. Monitor the simulated surgical operations performed by trainees on a virtual surgical model using AR devices, and provide feedback on the evaluation results of the corresponding simulated surgical operations to the trainees. In this embodiment, the user's learning progress is evaluated, and personalized learning suggestions and feedback are provided; AI technology is used to analyze the user's learning data to generate learning reports and improvement suggestions.

[0033] S4. Create a virtual classroom corresponding to the virtual surgical model and send an invitation link to all students who have completed the same virtual surgical model to participate in the virtual classroom.

[0034] In this embodiment, through AR devices and invitation links, students can participate in virtual classrooms, discussion groups, and collaborative projects. The system integrates students who are stuck on courses of similar difficulty or whose diagnostic results show similar deficiencies into a discussion group, where a dedicated virtual tutor provides unified answers and targeted training courses.

[0035] Please refer to Figure 2 Embodiment two of the present invention is as follows: A virtual medical training terminal 1 includes a memory 2, a processor 3, and a computer program stored on the memory 2 and capable of running on the processor 3. When the processor 3 runs the computer program, it implements a virtual medical training method according to Embodiment 1.

[0036] In summary, the virtual medical training method and terminal provided by this invention creates virtual surgical models and scenarios based on historical medical case data. These models and scenarios are then projected onto the trainee's real-world environment. Multi-dimensional analysis of the historical medical case data allows for a deep recreation of the complexity and diversity of real surgical scenarios. Surgical steps and operational details are extracted from surgical videos, and interactive elements are precisely configured for the virtual surgical model, enabling trainees to experience various operational situations that might occur in real surgery. Virtual surgical scenarios are generated based on patient medical history and surgical records, simulating surgical conditions under different illnesses and physical conditions, such as the management of complex complications and the handling of anesthesia risks for patients with special physical conditions. This allows trainees to accumulate diverse clinical experience during the training phase. Subsequently, trainees are guided to immerse themselves in a real surgical environment and perform surgical operations on the virtual surgical model, simulating real medical scenarios and achieving medical surgical simulation. This connects medical knowledge with actual surgical operations, enhances the interactivity of the training process, and improves the efficiency of practical application of medical knowledge. Furthermore, the virtual classroom provides students with a platform for centralized Q&A and knowledge expansion. It can systematically explain common problems encountered by students during operation, supplement cutting-edge medical knowledge and clinical cases, and maximize the integration and utilization of teaching resources.

[0037] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method of virtual medical training, characterized by, Includes the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee.

2. The method of claim 1, wherein, S1 includes: S11. Analyze the surgical steps and operation details from the surgical videos of historical medical case data, and configure the interactive elements of the virtual surgical model according to the surgical steps and operation details. S12. Generate a virtual surgical scene based on the patient's medical history and surgical records from historical medical case data.

3. The method of claim 1, wherein, S1 further includes: Based on patient age, medical history, and disease type from historical medical case data, virtual surgical models and virtual surgical scenarios of different difficulty levels are created; Generate a course list containing all the virtual surgical models and the virtual surgical scenarios.

4. The method of claim 1, wherein, The monitoring of the simulated surgical procedures performed by the trainee on the virtual surgical model via the AR device also includes: A virtual tutor is created using an AR device, and the virtual tutor sends real-time guidance information to the student.

5. The virtual medical training method according to claim 1, characterized in that, Also includes: S4. Create a virtual classroom corresponding to the virtual surgical model, and send an invitation link to all students who have completed the same virtual surgical model to participate in the virtual classroom.

6. A virtual medical training terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor runs the computer program, it performs the following steps: S1. Create virtual surgical models and virtual surgical scenarios based on historical medical case data; S2. Using the AR device worn by the trainee, the virtual surgical model and the virtual surgical scene are projected into the real environment where the trainee is located; S3. Monitor the simulated surgical operation performed by the trainee on the virtual surgical model through the AR device, and provide feedback on the evaluation results of the simulated surgical operation to the trainee.

7. A virtual medical training terminal according to claim 6, characterized in that, S1 includes: S11. Analyze the surgical steps and operation details from the surgical videos of historical medical case data, and configure the interactive elements of the virtual surgical model according to the surgical steps and operation details. S12. Generate a virtual surgical scene based on the patient's medical history and surgical records from historical medical case data.

8. A virtual medical training terminal according to claim 1, characterized in that, S1 further includes: Based on patient age, medical history, and disease type from historical medical case data, virtual surgical models and virtual surgical scenarios of different difficulty levels are created; Generate a course list containing all the virtual surgical models and the virtual surgical scenarios.

9. A virtual medical training terminal according to claim 6, characterized in that, The monitoring of the simulated surgical procedures performed by the trainee on the virtual surgical model via the AR device also includes: A virtual tutor is created using an AR device, and the virtual tutor sends real-time guidance information to the student.

10. A virtual medical training terminal according to claim 6, characterized in that, Also includes: S4. Create a virtual classroom corresponding to the virtual surgical model, and send an invitation link to all students who have completed the same virtual surgical model to participate in the virtual classroom.

Images