Lumbar puncture training system

Abstract

The invention relates to a lumbar puncture training system which comprises a master control system, and the master control system is connected with a three-dimensional model management subsystem, a puncture training subsystem, a training management subsystem and AR glasses. A three-dimensional model is preset in the three-dimensional model management subsystem, the three-dimensional model management subsystem is used for forming a training model, and the main control system is used for transmitting the training model to the AR glasses for display; the puncture training subsystem is used for judging whether the puncture information of the user on the entity model is matched with the puncture image information on the three-dimensional model or not; and the training management subsystem is used for managing information of students and recording puncture records of the students. According to the application, the VR / MR technology and the entity model are combined and applied to clinical skill practical operation teaching and real-time feedback of the operation process, and a basis is provided for error correction of students in the teaching process for teachers, so that the lumbar puncture success rate of living training doctors is improved, and the overall operation ability of lumbar puncture is improved.

Description

Technical Field

[0001] The present invention relates to the field of medical technology, and more specifically, it relates to a lumbar puncture training system. Background Art

[0002] Reviewing the statistical data of the lumbar puncture skill item assessment during the standardized training assessment of residents, the probability of losing points due to operation errors such as puncture site positioning and puncture technique is the highest in the puncture success rate scoring item. By using the augmented reality characteristics of 5G+AR / MR technology to present the dynamic vision of the patient's anatomical parts in a three-dimensional form and provide real-time feedback on the puncture process, the problem of puncture failure caused by inaccurate positioning or improper puncture technique in lumbar puncture operation can be solved, the success rate of lumbar puncture for physicians can be improved, and the goal of medical safety can be ultimately achieved.

[0003] Augmented Reality (AR) technology is a new technology that combines real-world information and virtual-world information content. It performs simulation processing on entity information that is difficult to experience in the spatial scope of the real world based on computer science and technology, and effectively applies the virtual information content in the real world, thereby achieving a sensory experience beyond reality. Mixed Reality (MR) includes both augmented reality and augmented virtuality, referring to a new visualization environment generated by merging the real and virtual worlds. In the new visualization environment, physical and digital objects coexist and interact in real time. The development and maturity of AR technology have enabled it to be more widely applied in fields such as medical, military, exhibition, and tourism. Currently, many scholars have applied AR technology in fields such as agricultural college education and teaching, vascular surgery, and cardiopulmonary resuscitation teaching. They believe that characteristics such as the immersion and interactivity of virtual reality enable students to be more immersed in the virtual skill training process, thus achieving better training effects. In terms of the development of training systems, Sun Yingu et al. independently developed VR teaching software such as the invasive pressure monitoring operation thinking training system, virtual simulation experimental teaching software for common pain treatment techniques, virtual simulation experimental teaching software for common first aid techniques, colposcopy operation thinking training system, hysteroscopy operation thinking training system, and obstetric delivery operation thinking training system for on-site clinical teaching, which has greatly improved the practical ability of clinical interns and cultivated excellent talents for clinical practice. Currently, there is no relevant research on the combination of VR / MR technology and physical models for clinical skill practical teaching. Summary of the Invention

[0004] Aiming at the deficiencies of the existing technology, the present invention proposes a lumbar puncture training system to simulate lumbar puncture training through virtual reality technology.

[0005] The present invention provides a lumbar puncture training system, and the technical solution is as follows:

[0006] A lumbar puncture training system includes a main control system, which is connected to a three-dimensional model management subsystem, a puncture training subsystem, a training management subsystem, and AR glasses; a three-dimensional model is preset in the three-dimensional model management subsystem, and the three-dimensional model management system is used to attach three-dimensional puncture information to the three-dimensional model to form a training model. The main control system is used to transmit the training model to the AR glasses for display; the puncture training subsystem is used to register the three-dimensional model and the physical model displayed in the AR glasses, and collect the puncture image information of the user on the physical model, so as to judge whether the puncture information of the user on the physical model matches the puncture image information on the three-dimensional model; the training management subsystem is used to manage the information of the trainees and record the puncture records of each trainee.

[0007] In summary, the above technical solution has the following beneficial effects: The lumbar puncture training system of the present application models the physical model, and registers the three-dimensional model and the physical model through the augmented reality technology, so as to record the puncture of the user on the physical model and judge whether the puncture is correct. The present application combines VR / MR technology with the physical model and applies it to clinical skills practical teaching. The operation process is real-time feedback, providing a basis for the instructor to correct students' mistakes in the teaching process, thereby improving the success rate of lumbar puncture for resident physicians and enhancing the overall operation ability of lumbar puncture. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 It is a schematic diagram of the module diagram of a lumbar puncture training system;

[0009] Figure 2 It is a schematic diagram of the operation interface of a lumbar puncture training system;

[0010] Figure 3 It is a schematic diagram of the area frame of a lumbar puncture training system;

[0011] Figure 4 It is a schematic diagram of the puncture needle of a lumbar puncture training system;

[0012] Figure 5 It is a schematic diagram of the physical model of a lumbar puncture training system.

[0013] Reference numerals: 10, main control system; 20, three-dimensional model management subsystem; 30, puncture training subsystem; 40, training management subsystem; 50, AR glasses; 60, physical model; 61, leather sheath; 62, main body; 621, water storage cavity; 70, puncture needle. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0014] The following clearly and completely describes the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0015] As Figure 1 shown, a lumbar puncture training system includes a main control system 10, the main control system 10 is connected to a three-dimensional model management subsystem 20, a puncture training subsystem 30, a training management subsystem 40, and an AR glasses 50; a three-dimensional model is preset in the three-dimensional model management subsystem 20, and the three-dimensional model management system is used to attach three-dimensional puncture information to the three-dimensional model to form a training model, and the main control system 10 is used to transmit the training model to the AR glasses 50 for display; the puncture training subsystem 30 is used to register the three-dimensional model and the physical model 60 displayed in the AR glasses 50, and collect the puncture image information of the user on the physical model 60, so as to judge whether the puncture information of the user on the physical model 60 matches the puncture image information on the three-dimensional model; the training management subsystem 40 is used to manage the information of the trainees and record the puncture records of each trainee.

[0016] The lumbar puncture training system of the present application models the physical model 60, and registers the three-dimensional model and the physical model 60 through augmented reality technology, so as to record the puncture of the user on the physical model 60 and judge whether the puncture is correct. The present application combines VR / MR technology with the physical model 60 and applies it to clinical skills practical teaching. The operation process is feedback in real time, providing a basis for the teaching teacher to correct students' mistakes in the teaching process, thereby improving the success rate of lumbar puncture of resident physicians and improving the overall operation ability of lumbar puncture.

[0017] The three-dimensional model management subsystem 20 is used to save each three-dimensional model and attach three-dimensional puncture image information to each three-dimensional model. The puncture image information includes puncture site graphic information, puncture path image information, etc. The three-dimensional model management subsystem 20 supports multiple three-dimensional virtual models to support different puncture training human physical models 60.

[0018] The puncture training subsystem 30 realizes image registration with the 3D model based on benchmark points such as the head of the puncture training entity model 60. During training operations, the trainee logs in through the main control system 10 and wears the AR glasses 50. The puncture training subsystem 30 renders the registered 3D model through the AR glasses 50 and superimposes it on the entity model 60 after 3D rendering. Through settings, the trainee can use the 3D model and puncture image information as a guide for puncture operations, improving the standardization and accuracy of puncture operations, enhancing the training effect, or it can also be set not to display the puncture image information for assessment purposes. The puncture training subsystem 30 records and saves the process of puncture practice and status information prompts on whether the puncture is successful, facilitating subsequent data statistics.

[0019] The training management subsystem 40 adopts a WEB architecture and provides services for training administrators. Its main functions include two parts: training management and statistical reports. Among them, training management mainly manages the basic information and account information of trainees; the statistical reports provide the training situation of each trainee in the form of charts, including information such as training duration, number of times, and puncture success rate, providing information support for the analysis of training situations.

[0020] The 3D model management subsystem 20 presets the 3D model through the following process:

[0021] St10: Obtain the spatial dimension information and point cloud data of the entity model 60 through 3D laser scanning;

[0022] St11: Import the spatial dimension information and point cloud data into reverse 3D modeling software to realize the construction of the 3D model.

[0023] Common reverse 3D modeling software includes UG, Geomagic DesignX, 3ds Max, Solidworks, etc. The main control system 10 is a control system. Based on the 3D model produced by reverse modeling, the 3D model management subsystem 20, the puncture training subsystem 30, and the training management subsystem 40 are developed based on the Physx physics engine and the Unity3D real-time rendering engine, and cooperate with the AR glasses 50 to form an augmented or mixed reality lumbar puncture training system.

[0024] The process of presetting the 3D model also includes the following:

[0025] St12: Attach 3D puncture image information to the 3D model.

[0026] As Figure 2 and Figure 3 shown, the registration includes the following process:

[0027] St20. The AR glasses 50 are used for the user to interact with the main control system 10. After the main control system 10 is turned on, an operation interface is displayed on the AR glasses 50. The operation interface includes a search button, a model placement button, and a lock button;

[0028] St21. When the main control system 10 fails to search for the physical model 60, a region box is displayed on the AR glasses for the user to move to cover the entire physical model 60;

[0029] St22. After the region box covers the entire physical model 60, when the user clicks the search button, the puncture training subsystem 30 searches for the physical model 60 within the region box;

[0030] St23. After the puncture training subsystem 30 searches for the physical model 60, when the user clicks the model release button, the puncture training subsystem 30 registers the three-dimensional model with the physical model 60;

[0031] St24. After the puncture training subsystem 30 registers the three-dimensional model with the physical model 60, when the user clicks the lock button, the puncture training subsystem 30 locks the three-dimensional model. After the three-dimensional model is locked, the position of the three-dimensional model will not change when the user wears the AR glasses 50 and moves.

[0032] Collecting the puncture information of the user on the physical model 60 includes the following process:

[0033] St31. The operation interface also includes an assessment mode button. After clicking the assessment mode button, a QR code scanning area is displayed on the AR glasses 50 for scanning the user's personal information QR code;

[0034] St32. After the AR glasses 50 scan the personal information QR code, the corresponding user enters the assessment mode, and the AR glasses 50 do not display the three-dimensional model and puncture image information;

[0035] St33. When the user punctures the physical model 60 with the puncture needle 70, the puncture training subsystem 30 collects the position of the puncture needle 70 in real time;

[0036] St34. When the user completes the puncture and feeds back to the main control system 10, the puncture training subsystem 30 determines whether the puncture needle 70 matches the puncture image information;

[0037] St35. If the puncture training subsystem 30 determines that the puncture needle 70 matches the puncture image, it prompts that the positioning is successful;

[0038] St36. If the puncture training subsystem 30 determines that the puncture needle 70 does not match the puncture image, it prompts that it is unsuccessful and displays the puncture image information. After the user feeds back to the main control system 10 to hide the puncture image information, the user can use the puncture needle 70 to puncture again;

[0039] St37. When the user completes the puncture assessment and feeds back to the main control system 10, the training management subsystem 40 is used to record the assessment information of the user.

[0040] Collecting the puncture information of the user on the physical model 60 includes the following process:

[0041] St41. The operation interface also includes a training mode button. When the training mode button is clicked and the user punctures the physical model 60 with the puncture needle 70, the puncture training subsystem 30 collects the position of the puncture needle 70 in real time.

[0042] St42. When the user completes the puncture and feeds back to the main control system 10, the puncture training subsystem 30 determines whether the puncture needle 70 and the puncture image information match.

[0043] St43. If the puncture training subsystem 30 determines that the puncture needle 70 and the puncture image match, it prompts that the positioning is successful.

[0044] St44. If the puncture training subsystem 30 determines that the puncture needle 70 and the puncture image do not match, it prompts that it is unsuccessful. After the user feeds back to the main control system 10, the mismatched puncture needle 70 can be cancelled and the puncture can be performed again.

[0045] The user feeds back to the main control system 10 through voice commands.

[0046] Such as Figure 4 and Figure 5 As shown, a two-dimensional code is set on the puncture needle 70, and the puncture training subsystem 30 collects the position information of the corresponding puncture needle 70 through the two-dimensional code.

[0047] In the assessment mode, clicking on "Login" will scan the student's two-dimensional code. After successful scanning, "Login Successful" will be displayed in the scanning area. After logging in successfully, click "Start Operation" to enter the assessment. The puncture needle 70 used during the puncture is connected to a two-dimensional code for positioning the virtual needle. During the assessment, try to keep the two-dimensional code within the field of view and do not block it. After finding the puncture point, align the puncture needle 70 with the point and input the voice command: "Positioning Complete". If the position is misaligned, a prompt message will appear. At this time, the lumbar vertebra of the model and the correct position of the puncture needle 70 will be displayed. Input the voice command: "Hide All", and the lumbar vertebra and the puncture needle 70 will be hidden. Then reposition and re-enter the voice command: "Positioning Complete". If the position is successfully located, it will prompt that the positioning is successful. At this time, insert the puncture needle 70 into the model. After the puncture needle 70 is inserted into the model, input the voice command: "Puncture Complete". If the puncture position is incorrect, a prompt message will appear. At this time, the lumbar vertebra of the model and the correct position of the puncture needle 70 will be displayed. If the position is successfully located, it will prompt that the positioning is successful. At this time, insert the puncture needle 70 into the model. The assessment information will be automatically uploaded.

[0048] In the training mode, after the model is successfully placed, click "Start Operation" to enter the training mode. Voice commands: "Positioning completed": The command to be said when aligning the puncture needle 70 with the puncture position. There will be prompts for both successful and failed positioning. After a failed positioning, the command can be said again to reposition. If the positioning is successful, insert the puncture needle 70 into the model according to the procedure. "Continue operation": After a failed positioning, saying "Continue operation" can skip the positioning and continue the puncture operation. "Puncture completed": The command to be said after inserting the puncture needle 70 into the model. There will be prompts for both successful and failed punctures. Other commands: "Show puncture needle 70", "Hide puncture needle 70", "Show lumbar vertebra", "Hide lumbar vertebra", "Show all", "Hide all".

[0049] The solid model 60 is provided with a water storage cavity 621 at the puncture site. The solid model 60 includes a detachable leather sheath 61 and a main body 62. The water storage cavity 621 is opened on the main body 62, and the leather sheath 61 is used to cover the main body 62. The leather sheath 61 and the main body 62 together form the solid model 60. After the leather sheath 61 is punctured by the puncture needle 70 multiple times, multiple needle holes will be formed, which will affect the next puncture simulation. Therefore, a detachable leather sheath 61 is provided outside the solid model 60, so that it can be replaced after the leather sheath 61 has been used multiple times and left too many needle holes. A water bag can be arranged in the water outlet cavity. The water bag is made of materials such as rubber or plastic. The circular water bag contains water, and then the water bag is placed in the water storage cavity 621. When the puncture is successful, withdraw the puncture needle 70 from the model according to the procedure to see if water droplets flow out. If water droplets flow out, it is judged that the puncture position and depth are correct.

[0050] The above are only the preferred embodiments of the present invention. The protection scope of the present invention is not limited to the above embodiments. All technical solutions falling within the idea of the present invention belong to the protection scope of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and refinements should also be regarded as within the protection scope of the present invention.

Claims

1. A lumbar puncture training system, characterized in that: It comprises a main control system (10), wherein the main control system (10) is connected to a three-dimensional model management subsystem (20), a puncture training subsystem (30), a training management subsystem (40) and AR glasses (50); The three-dimensional model management subsystem (20) is preset with a three-dimensional model, the three-dimensional model management system is used to add three-dimensional puncture information to the three-dimensional model to form a training model, and the main control system (10) is used to transmit the training model to the AR glasses (50) for display; The puncture training subsystem (30) is used to align the three-dimensional model displayed in the AR glasses (50) with the physical model (60), and collect puncture image information of the user on the physical model (60), so as to determine whether the puncture information of the user on the physical model (60) matches the puncture image information on the three-dimensional model; The training management subsystem (40) is used to manage trainees' information and record the puncture records of each trainee.

2. A lumbar puncture training system according to claim 1, characterized in that: The three-dimensional model management subsystem (20) presets the three-dimensional model through the following process: St10, obtaining spatial dimension information and point cloud data of the solid model (60) by three-dimensional laser scanning; St11. Import the spatial dimension information and point cloud data into the reverse 3D modeling software to realize the construction of the 3D model.

3. A lumbar puncture training system according to claim 2, characterized in that: Pre-setting the 3D model also includes the following processes: St12. Attach three-dimensional puncture image information to the three-dimensional model.

4. A lumbar puncture training system according to claim 1, characterized in that: Registration includes the following processes: St20, the AR glasses (50) are used for human-computer interaction between a user and a main control system (10), and after the main control system (10) is turned on, an operation interface is displayed on the AR glasses (50), and the operation interface includes a search button, a model placement button, and a lock button; St21, when the main control system (10) fails to search for the physical model (60), a region frame is displayed on the AR glasses, wherein the region frame is used for the user to move to cover the entire physical model (60); St22, when the area frame covers the entire entity model (60), the user clicks the search button, and the puncture training subsystem (30) searches for the entity model (60) in the area frame; St23, when the puncture training subsystem (30) searches for the physical model (60), the user clicks a model release button, and the puncture training subsystem (30) registers the three-dimensional model with the physical model (60); St24. After the puncture training subsystem (30) aligns the three-dimensional model and the physical model (60), the user clicks the lock button, and the puncture training subsystem (30) locks the three-dimensional model. After the three-dimensional model is locked, the user wearing the AR glasses (50) and moving will not change the position of the three-dimensional model.

5. A lumbar puncture training system according to claim 4, characterized in that: Collecting the puncture information of the user on the physical model (60) includes the following process: St31, the operation interface further comprises an assessment mode button, after the assessment mode button is clicked, a code scanning area is displayed on the AR glasses (50) for scanning a QR code of the user's personal information; St32, after the AR glasses (50) scan the personal information QR code, the corresponding user enters the assessment mode, and the AR glasses (50) do not display the three-dimensional model and puncture image information; St33, when the user punctures the physical model (60) with the puncture needle (70), the puncture training subsystem (30) collects the position of the puncture needle (70) in real time; St34, when the user completes the puncture and feeds back to the main control system (10), the puncture training subsystem (30) determines whether the puncture needle (70) and the puncture image information match; St35, if the puncture training subsystem (30) determines that the puncture needle (70) matches the puncture image, it indicates that the positioning is successful; St36, if the puncture training subsystem (30) determines that the puncture needle (70) and the puncture image do not match, it prompts that it is unsuccessful and displays the puncture image information. After the user feedbacks the main control system (10) to hide the puncture image information, the puncture needle (70) can be used again for puncture; St37. When the user completes the puncture assessment and provides feedback to the main control system (10), the training management subsystem (40) is used to record the user's assessment information.

6. A lumbar puncture training system according to claim 4, characterized in that: Collecting the puncture information of the user on the physical model (60) includes the following process: St41, the operation interface further comprises a training mode button, when the training mode button is clicked, when the user punctures the physical model (60) with the puncture needle (70), the puncture training subsystem (30) collects the position of the puncture needle (70) in real time; St42, when the user completes the puncture and feeds back to the main control system (10), the puncture training subsystem (30) determines whether the puncture needle (70) and the puncture image information match; St43, if the puncture training subsystem (30) determines that the puncture needle (70) matches the puncture image, it indicates that the positioning is successful; St44. If the puncture training subsystem (30) determines that the puncture needle (70) and the puncture image do not match, it will prompt that it is unsuccessful. After the user feedbacks to the main control system (10), the unmatched puncture needle (70) can be cancelled and the puncture can be repeated.

7. A lumbar puncture training system according to claim 5 or 6, characterized in that: The user feedback main control system (10) provides feedback through voice commands.

8. A lumbar puncture training system according to claim 5 or 6, characterized in that: The puncture needle (70) is provided with a two-dimensional code, and the puncture training subsystem (30) collects position information corresponding to the puncture needle (70) through the two-dimensional code.

9. A lumbar puncture training system according to any one of claims 1 to 8, characterized in that: The physical model (60) is provided with a water storage cavity (621) at the puncture site.

Images