Ophthalmic traditional Chinese and western medicine MR teaching and training system

Abstract

The invention relates to the technical field of medical education, in particular to an ophthalmology traditional Chinese and western medicine MR teaching and training system, and the system comprises an MR teaching platform module which is used for constructing a three-dimensional ophthalmology dissection and traditional Chinese medicine meridian fusion visual scene and supporting transparent and layered display; the traditional Chinese medicine manipulation simulation training module is used for realizing virtual operation and real-time feedback of acupuncture, massage and moxibustion through motion capture; and the assessment and evaluation module is used for carrying out quantitative evaluation on acupuncture point positioning and manipulation operation of the trainee and generating a comprehensive score through an AI algorithm. The system has the beneficial effects that the problems of abstract anatomical structure, high practical operation risk and high evaluation subjectivity in traditional ophthalmology teaching are solved, and integration visualization of traditional and western medicine knowledge and intelligence and standardization of skill training assessment are realized.

Description

Technical Field

[0001] This invention relates to the field of medical education technology, specifically to an ophthalmology integrated traditional Chinese and Western medicine MR teaching and training system, and more specifically to an ophthalmology integrated traditional Chinese and Western medicine simulation teaching, skills training and assessment system that combines mixed reality, human-computer interaction and artificial intelligence technologies. Background Technology

[0002] Currently, ophthalmology education, especially the teaching of traditional Chinese medicine ophthalmology techniques such as acupuncture and massage, mainly relies on traditional teaching models, which presents the following problems:

[0003] 1. Anatomical structures are abstract, and traditional two-dimensional textbooks cannot intuitively demonstrate the spatial relationship between the fine structures of the eye and the meridians in traditional Chinese medicine;

[0004] 2. Practical training carries safety risks and cannot be repeatedly practiced on real patients;

[0005] 3. The performance evaluation relies on the supervisor's subjective experience and lacks objective quantitative standards;

[0006] 4. It is difficult to deeply integrate and present knowledge of traditional Chinese medicine and Western medicine in the same teaching scenario.

[0007] While existing virtual reality simulators have made some progress, they lack immersion and interactivity, and fail to effectively quantify the assessment of skills in integrating traditional Chinese and Western medicine. Therefore, there is an urgent need for a teaching system that can integrate knowledge of both traditional Chinese and Western medicine, support safe practical operation, and provide intelligent evaluation. Summary of the Invention

[0008] To overcome the technical deficiencies in existing technologies and effectively solve the technical problems in the background art, this invention provides an ophthalmology integrated traditional Chinese and Western medicine MR teaching and training system. Specifically, it is an ophthalmology integrated traditional Chinese and Western medicine simulation teaching, skills training, and assessment system that combines mixed reality, human-computer interaction, and artificial intelligence technologies. The system uses mixed reality technology to achieve the visual integration of traditional Chinese and Western medicine knowledge, constructs a safe virtual practical environment, and establishes an objective evaluation system based on data and AI. Its specific technical solution is as follows:

[0009] A teaching and training system for ophthalmic MR (Traditional Chinese and Western Medicine) techniques includes the following modules:

[0010] The teaching platform module is used to provide a three-dimensional visualization teaching scenario for ophthalmic anatomy and traditional Chinese medicine meridians based on mixed reality devices;

[0011] The Traditional Chinese Medicine Techniques Simulation Training Module is used to simulate acupuncture, massage, and moxibustion operations through motion capture equipment and provides real-time interactive feedback.

[0012] The assessment and evaluation module is used to record user operation data, perform quantitative scoring based on preset standards, and generate evaluation reports.

[0013] As a preferred embodiment of the present invention, the teaching platform module includes:

[0014] The ocular anatomy model unit is used to dynamically display the structure of the eyeball, extraocular muscles, and optic nerve pathways;

[0015] The TCM meridian and acupoint unit is used to overlay and display the pathways and acupoint locations of the Foot Taiyang Bladder Meridian and Foot Shaoyang Gallbladder Meridian around the eyes;

[0016] The visualization control unit allows users to make the anatomical model transparent, display it in layers, and simulate blood flow direction.

[0017] As a preferred embodiment of the present invention, the traditional Chinese medicine manipulation simulation training module includes:

[0018] The acupuncture simulation unit is used to provide virtual needles, detect the needle insertion depth and angle in real time, and issue a warning when it deviates from the standard.

[0019] The massage simulation unit is used to capture the user's hand movement trajectory, frequency and force, and supports step-by-step teaching and pause;

[0020] The moxibustion simulation unit is used to simulate the moxibustion operation process;

[0021] Contextualized case units are used to construct virtual patient consultation and treatment scenarios based on real cases.

[0022] As a preferred embodiment of the present invention, the assessment and evaluation module includes:

[0023] The skills assessment unit is used to perform real-time detection and error analysis on acupoint spatial positioning and standardized manipulation techniques.

[0024] The AI ​​assessment unit is used to comprehensively score knowledge mastery, skill proficiency, and clinical reasoning from multiple dimensions based on operation log data and through a preset scoring model.

[0025] The data recording unit is used to store assessment scores, time taken, accuracy rate, and operation trajectory, and to generate a personal skill heatmap.

[0026] As a preferred embodiment of the present invention, the scoring model of the AI ​​evaluation unit includes:

[0027] Knowledge mastery accounts for 40%, skill proficiency accounts for 30%, and clinical reasoning accounts for 30%.

[0028] As a preferred embodiment of the present invention, it further includes:

[0029] The virtual narration unit is used to provide bilingual (Chinese and English) audio explanations and 3D annotation guidance.

[0030] Multi-user collaboration units support multiple users in a mixed reality scenario to collaboratively complete simulated surgeries or case discussions.

[0031] An operating method for an ophthalmic MR teaching and training system combining traditional Chinese and Western medicine includes the following steps:

[0032] Step 1: Construct a three-dimensional fusion model of eye anatomy and traditional Chinese medicine meridians, and support user interaction.

[0033] Step 2: Collect user's manual operation data using motion capture equipment and compare it with standard operating parameters in real time;

[0034] Step 3: In assessment mode, record the user's operation trajectory, time and accuracy, and generate evaluation results based on AI algorithms;

[0035] Step 4: Output a personal skills analysis report and learning suggestions.

[0036] Compared with the prior art, the beneficial effects of the present invention are: Attached Figure Description

[0037] Figure 1 This is a structural block diagram of the system of the present invention. Detailed Implementation

[0038] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0039] Please see Figure 1 This invention provides a technical solution: an ophthalmic MR teaching and training system integrating traditional Chinese and Western medicine, comprising the following modules:

[0040] The teaching platform module is used to provide a three-dimensional visualization teaching scenario for ophthalmic anatomy and traditional Chinese medicine meridians based on mixed reality devices;

[0041] The Traditional Chinese Medicine Techniques Simulation Training Module is used to simulate acupuncture, massage, and moxibustion operations through motion capture equipment and provides real-time interactive feedback.

[0042] The assessment and evaluation module is used to record user operation data, perform quantitative scoring based on preset standards, and generate evaluation reports.

[0043] Furthermore, the teaching platform module includes:

[0044] The ocular anatomy model unit is used to dynamically display the structure of the eyeball, extraocular muscles, and optic nerve pathways;

[0045] The TCM meridian and acupoint unit is used to overlay and display the pathways and acupoint locations of the Foot Taiyang Bladder Meridian and Foot Shaoyang Gallbladder Meridian around the eyes;

[0046] The visualization control unit allows users to make the anatomical model transparent, display it in layers, and simulate blood flow direction.

[0047] Furthermore, the TCM manipulation simulation training module includes:

[0048] The acupuncture simulation unit is used to provide virtual needles, detect the needle insertion depth and angle in real time, and issue a warning when it deviates from the standard.

[0049] The massage simulation unit is used to capture the user's hand movement trajectory, frequency and force, and supports step-by-step teaching and pause;

[0050] The moxibustion simulation unit is used to simulate the moxibustion operation process;

[0051] Contextualized case units are used to construct virtual patient consultation and treatment scenarios based on real cases.

[0052] Furthermore, the aforementioned assessment and evaluation modules include:

[0053] The skills assessment unit is used to perform real-time detection and error analysis on acupoint spatial positioning and standardized manipulation techniques.

[0054] The AI ​​assessment unit is used to comprehensively score knowledge mastery, skill proficiency, and clinical reasoning from multiple dimensions based on operation log data and through a preset scoring model.

[0055] The data recording unit is used to store assessment scores, time taken, accuracy rate, and operation trajectory, and to generate a personal skill heatmap.

[0056] Furthermore, the scoring model of the AI ​​evaluation unit includes:

[0057] Knowledge mastery accounts for 40%, skill proficiency accounts for 30%, and clinical reasoning accounts for 30%.

[0058] Furthermore, it also includes:

[0059] The virtual narration unit is used to provide bilingual (Chinese and English) audio explanations and 3D annotation guidance.

[0060] Multi-user collaboration units support multiple users in a mixed reality scenario to collaboratively complete simulated surgeries or case discussions.

[0061] An operating method for an ophthalmic MR teaching and training system combining traditional Chinese and Western medicine includes the following steps:

[0062] Step 1: Construct a three-dimensional fusion model of eye anatomy and traditional Chinese medicine meridians, and support user interaction.

[0063] Step 2: Collect user's manual operation data using motion capture equipment and compare it with standard operating parameters in real time;

[0064] Step 3: In assessment mode, record the user's operation trajectory, time and accuracy, and generate evaluation results based on AI algorithms;

[0065] Step 4: Output a personal skills analysis report and learning suggestions.

[0066] Specifically, when using it:

[0067] The system runs on mixed reality devices such as HoloLens, and users operate it via gestures or a controller. The teaching platform module loads a high-precision eye anatomy model and traditional Chinese medicine meridian data, allowing users to control the model's transparency and cutting layers via voice or gestures. The traditional Chinese medicine manipulation simulation training module captures the user's hand movements using a controller to simulate acupuncture needle insertion, massage, scraping, and other operations. The system displays the needle insertion depth and angle deviation in real time and alerts users to risks when errors occur.

[0068] In the assessment mode, the system randomly selects acupoints and requires the user to locate them, checking whether the error exceeds 2mm; the massage operation must meet the preset frequency and intensity curve. All operation data is uploaded to the backend, and the AI ​​assessment unit generates a scoring report based on the model of "knowledge mastery 40% + skill proficiency 30% + clinical reasoning 30%", and attaches a heat map to show the skill weaknesses.

[0069] The system can also integrate virtual digital human instructors for bilingual explanations and support multiple people to collaboratively complete simulated surgeries such as "removal of foreign bodies from the orbit," enhancing teaching interactivity and collaboration.

[0070] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A teaching and training system for ophthalmic MR (Traditional Chinese and Western Medicine) techniques, characterized in that: Includes the following modules: The teaching platform module is used to provide a three-dimensional visualization teaching scenario for ophthalmic anatomy and traditional Chinese medicine meridians based on mixed reality devices; The Traditional Chinese Medicine Techniques Simulation Training Module is used to simulate acupuncture, massage, and moxibustion operations through motion capture equipment and provides real-time interactive feedback. The assessment and evaluation module is used to record user operation data, perform quantitative scoring based on preset standards, and generate evaluation reports.

2. The ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to claim 1, characterized in that: The teaching platform module includes: The ocular anatomy model unit is used to dynamically display the structure of the eyeball, extraocular muscles, and optic nerve pathways; The TCM meridian and acupoint unit is used to overlay and display the pathways and acupoint locations of the Foot Taiyang Bladder Meridian and Foot Shaoyang Gallbladder Meridian around the eyes; The visualization control unit allows users to make the anatomical model transparent, display it in layers, and simulate blood flow direction.

3. The ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to claim 1, characterized in that: The traditional Chinese medicine manipulation simulation training module includes: The acupuncture simulation unit is used to provide virtual needles, detect the depth and angle of needle insertion in real time, and issue a warning when it deviates from the standard. The massage simulation unit is used to capture the user's hand movement trajectory, frequency and force, and supports step-by-step teaching and pause; The moxibustion simulation unit is used to simulate the moxibustion operation process; Contextualized case units are used to construct virtual patient consultation and treatment scenarios based on real cases.

4. The ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to claim 1, characterized in that: The assessment and evaluation module includes: The skills assessment unit is used to perform real-time detection and error analysis on acupoint spatial positioning and standardized manipulation techniques. The AI ​​assessment unit is used to comprehensively score knowledge mastery, skill proficiency, and clinical reasoning from multiple dimensions based on operation log data and through a preset scoring model. The data recording unit is used to store assessment scores, time taken, accuracy rate, and operation trajectory, and to generate a personal skill heatmap.

5. The ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to claim 4, characterized in that: The scoring model of the AI ​​evaluation unit includes: Knowledge mastery accounts for 40%, skill proficiency accounts for 30%, and clinical reasoning accounts for 30%.

6. The ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to claim 1, characterized in that: Also includes: The virtual narration unit is used to provide bilingual (Chinese and English) audio explanations and 3D annotation guidance. Multi-user collaboration units support multiple users in a mixed reality scenario to collaboratively complete simulated surgeries or case discussions.

7. The operating method of the ophthalmic integrated traditional Chinese and Western medicine MR teaching and training system according to any one of claims 1-6, characterized in that: Includes the following steps: Step 1: Construct a three-dimensional fusion model of eye anatomy and traditional Chinese medicine meridians, and support user interaction. Step 2: Collect user's manual operation data using motion capture equipment and compare it with standard operating parameters in real time; Step 3: In assessment mode, record the user's operation trajectory, time and accuracy, and generate evaluation results based on AI algorithms; Step 4: Output a personal skills analysis report and learning suggestions.

Images