Training system and method for automatic evaluation of tracheal intubation operation based on embedded and three-dimensional visualization combination

Abstract

The invention discloses a training system and method for automatic evaluation of tracheal intubation operation based on the combination of embedded and three-dimensional visualization, the system comprises a trachea model and an esophagus model which simulate a human body structure, the trachea model comprises a glottis, a main trachea, a left bronchus and a right bronchus, metal detection sensors are installed at the positions of the glottis, the main trachea, the left main bronchus, the right main bronchus and the esophagus, the metal detection sensors are used for detecting whether metal passes through a channel of the part where the metal detection sensors are located or not, and the metal detection sensors are connected with an embedded control system and send detected information to the embedded control system. Induction data transmission based on key points such as the position, the force, the depth and the speed which cannot be directly observed by human eyes in the intubation process is achieved, communication and interaction with the three-dimensional simulation model are achieved, the operation process is displayed in a visual mode, automatic evaluation can be achieved, and quantification, standardization and normalization of operation examination are finally achieved.

Description

Technical Field

[0001] The present invention relates to the field of medical education and training operations, and in particular to a training system and method for automatic evaluation of tracheal intubation operations based on a combination of embedded systems and three-dimensional visualization. Background Art

[0002] The traditional endotracheal intubation training process is judged by professional teachers on-site evaluation. The teacher's experience is used to judge whether the trainee's intubation position, force, depth, and speed are correct. However, this training method has the following five problems: (1) It is highly dependent on the teacher and his experience; (2) It is difficult to quantify the effectiveness of practical training; (3) The training is boring, the training model is not interactive, and the students are not very motivated; (4) Training can only be conducted in class. Due to the limitations of venue and time, not every student can receive the teacher's guidance in class. (5) For endotracheal intubation, due to the cover of the model, the teacher cannot directly judge the correctness of the trainee's operation.

[0003] With the advancement of science and technology, the maturity of 3D simulation technology, and the integration of multiple disciplines such as embedded modularization, it has great application potential in the field of medical education and training. However, there is currently a lack of a training system that can combine 3D simulation technology and embedded systems. Summary of the invention

[0004] The purpose of the present invention is to provide a training system and method for automatic evaluation of tracheal intubation operation based on a combination of embedded and three-dimensional visualization, so as to improve the training efficiency and effect.

[0005] To achieve the above purpose, the technical solution adopted by the present invention is as follows:

[0006] On the one hand, the present invention provides a training system for automatic evaluation of tracheal intubation operations based on a combination of embedded and three-dimensional visualization, which includes a tracheal model and an esophagus model that simulate the human body structure, the tracheal model includes a glottis, a main trachea, a left bronchus and a right bronchus, and metal detection sensors are installed at the glottis, the main trachea, the left main bronchus, the right main bronchus and the esophagus. The metal detection sensors are used to detect whether there is metal passing through the channel of the part where they are located, and the metal detection sensors are connected to the embedded control system to send the detected information to the embedded control system.

[0007] Furthermore, the embedded control system includes a main controller, a sensor control module, a network module and a display module.

[0008] Furthermore, the embedded controller is connected to the background server via a WIFI network for data interaction.

[0009] Furthermore, when performing a simulated endotracheal intubation operation, the metal detection sensor is used to detect, collect and record data. The system analyzes which part of the metal detection sensor the metal catheter passes through. If it passes through the glottis and trachea, the result is judged to be correct; if it passes through the main bronchus, the result is judged to be not inserted too deep; if it passes through the esophagus, the result is judged to be incorrect.

[0010] Furthermore, the metal detection sensor determines whether it is triggered by detecting changes in inductance, thereby determining the location of the cannula; the embedded control system obtains the message that the metal detection sensor is triggered through a pin interrupt event, and transmits the cannula location data to the server, and the server controls the three-dimensional application to play different animations to achieve intuitive and timely effect display.

[0011] Furthermore, plastic materials are used to simulate the glottis, trachea, main bronchi and esophagus, silicone materials are used to simulate skin and muscle tissue, and the overall structure simulates the basic structure of the human body.

[0012] On the other hand, the present invention also provides a training method for automatic evaluation of tracheal intubation operation based on the combination of embedded and three-dimensional visualization, the training steps are:

[0013] Step 1: Start the camera and adjust the camera angle to a suitable angle to fully capture the operation area;

[0014] Step 2: Open the web program and log in to the endotracheal intubation 3D training platform with your account and password. After logging in, check whether the camera is shooting normally.

[0015] Step 3, opening the embedded controller on the endotracheal intubation simulator;

[0016] Step 4. After completing the above operations, click the start button on the page and then start training. During the operation, the metal detection sensors installed on the simulated human glottis, trachea, left main bronchus, right main bronchus and esophagus will detect the location of the metal intubation tube, and then the embedded controller will transmit the current information to the background server through the network;

[0017] Step 5: After each training session, statistical records of the data are made; the training video is automatically saved for later playback.

[0018] Furthermore, by distinguishing the material of the model from the material of the catheter used in the endotracheal intubation operation, conditions are created for detecting the catheter using a metal detection sensor.

[0019] Furthermore, the operating catheter is detected by using a metal detection sensor to identify and determine the specific position of the model where the catheter is located.

[0020] Furthermore, the following criteria are used according to the results of the operation: (1) Glottal triggering: the tube begins to enter the main trachea, which is a normal operation; (2) Tracheal triggering: the tube is located in the main trachea, which is a normal operation; (3) Left main bronchus and right main bronchus triggering: the tube passes through the main trachea and enters the bronchus, which is an over-operation; (4) Esophageal triggering: the tube does not enter the main trachea but enters the esophagus, which is an incorrect operation.

[0021] The beneficial effect of the present invention is that the present invention enables medical staff to intuitively judge whether their operation is correct and standard, thereby achieving the purpose of training. The system realizes the detection of the key position of the intubation, and the system can be combined with three-dimensional visualization to realize intuitive and timely effect display. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic diagram of a training system for automatic evaluation of endotracheal intubation operation of the present invention;

[0023] Figure 2 It is a flow chart of the training method for automatic evaluation of endotracheal intubation operation of the present invention. DETAILED DESCRIPTION

[0024] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] Embodiment 1

[0026] like Figure 1 A training system for automatic evaluation of tracheal intubation operations based on a combination of embedded and three-dimensional visualization, including a tracheal model and an esophagus model that simulate the human body structure, wherein the tracheal model includes a glottis, a main trachea, a left bronchus and a right bronchus, wherein plastic materials are used to simulate the glottis, trachea, main bronchus and esophagus, and silicone materials are used to simulate skin muscle tissue, and the overall architecture simulates the basic structure of the human body; and metal detection sensors are installed at the positions of the glottis, main trachea, left main bronchus, right main bronchus and esophagus, wherein the metal detection sensors are used to detect whether there is metal passing through the channel of the part where it is located, and the metal detection sensors are connected to an embedded control system to send the detected information to the embedded control system.

[0027] The embedded control system includes a main controller, a sensor control module, a network module and a display module. The embedded controller is connected to the background server through a WIFI network for data exchange. When performing a simulated tracheal intubation operation, the metal detection sensor is used to detect and collect and record data. The system analyzes which part of the metal detection sensor the metal catheter passes through. If it passes through the glottis and trachea, the result is judged to be correct. If it passes through the main bronchus, the result is judged to be not inserted too deep. If it passes through the esophagus, the result is judged to be wrong.

[0028] The metal detection sensor determines whether it is triggered by detecting changes in inductance, thereby determining the location of the cannula; the embedded control system obtains the message that the metal detection sensor is triggered through a pin interrupt event, and transmits the cannula location data to the server, and the server controls the three-dimensional application to play different animations to achieve intuitive and timely effect display.

[0029] Embodiment 2

[0030] like Figure 2 , a training method for automatic evaluation of tracheal intubation operation based on the combination of embedded and three-dimensional visualization, comprising the following steps:

[0031] Step 1: Prepare the training record camera, start the camera, and adjust the camera angle to a suitable angle to fully capture the operation area;

[0032] Step 2: Open the web program and enter your account and password to log in to the training platform. After entering the 3D endotracheal intubation training platform, you can see the camera image and the initial 3D animation state of the endotracheal intubation.

[0033] Step 3: Open the embedded controller on the endotracheal intubation simulator. When using it for the first time, you need to press and hold the button above to reset the settings. The specific steps are as follows:

[0034] Press and hold the reset button for five seconds to enter the reset procedure;

[0035] Turn on the WIFI on your phone, and you will find a hotspot network called ESP_ETT. Click on the network to connect.

[0036] After the connection is successful, open the browser on the mobile phone and enter http: / / esp_ett.local to access the page. The network configuration page will pop up. Enter the available WIFI name (without Chinese characters) and password, as well as the deployed SOCKET service address. Click Submit. At this time, the embedded system of the tracheal intubation will actively connect to the WIFI and background service.

[0037] The TFT LCD screen on the embedded controller will display the system's operating status. When the embedded system cannot establish a normal network connection with the server, it is necessary to detect the current network environment or reset the operation to ensure that subsequent steps can proceed normally.

[0038] Step 4. After completing the above operations, click the start button on the page to start training. During the operation, the sensor will identify the inserted trachea position and play an animation on the web page, while displaying the inserted position.

[0039] During operation, the metal detection sensor can give a prompt when sensing metal passing through the channel by simulating the glottis, trachea, left and right main bronchi, and the inner wall of the esophagus in plastic and silicone models, and the metal inner core of the tracheal tube. The sensor is connected to the embedded control system, and the embedded controller is connected to the backend server through the WIFI network for data interaction. When performing the tracheal intubation simulation operation, the metal detection sensor detects the prompt data collection and recording, and analyzes which metal detection sensors the metal catheter passes through. The metal detection sensor determines whether it is triggered based on the change in inductance detected; the embedded system uses the interrupt characteristics of the pin to update the detection status when the output level of the metal detection sensor changes, and transmits the current change data to the backend server through the previously established network; the three-dimensional simulation program has previously created corresponding animations of the glottis, trachea, left main bronchi, right main bronchi, and esophagus being triggered. When the embedded system notifies the status update, the three-dimensional simulation program plays the corresponding animation to achieve intuitive and timely training effect display.

[0040] The following criteria are used to distinguish the operation results: (1) Glottal triggering: the tube begins to enter the main trachea, which is a normal operation; (2) Tracheal triggering: the tube is located in the main trachea, which is a normal operation; (3) Left main bronchus and right main bronchus triggering: the tube passes through the main trachea and enters the bronchus, which is an over-operation; (4) Esophageal triggering: the tube does not enter the main trachea but enters the esophagus, which is an incorrect operation.

[0041] Step 5: After each training session, the data is recorded and saved; the training video is automatically saved and can be played back.

[0042] In the above process, the key position of the intubation is detected: Step 4 uses a metal intubation tube and a metal detection sensor. When the metal intubation tube passes through the metal detection sensors installed in the glottis, trachea, left main bronchus, right main bronchus and esophagus, it will cause the inductance of the detection sensor to change. The pin interrupt of the embedded controller is used to capture the trigger state of the sensor, thereby determining the position of the intubation tube.

[0043] In the above process, the combination of embedded system and 3D visualization is realized: Step 4 uses metal detection sensor and embedded controller to obtain the operation status of tracheal intubation, interacts with 3D application through network transmission, and 3D application plays different operation animations.

[0044] In summary, the present invention realizes the transmission of inductive data based on key points such as position, force, depth, speed, etc. during the intubation process that cannot be directly observed by the human eye, and interacts with the three-dimensional simulation model to display the operation process in a visual manner, and can realize automatic evaluation based on assessment points such as position, force, depth, speed, etc., so as to ultimately achieve quantification, standardization and normalization of operation assessment.

[0045] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the above embodiments do not limit the protection scope of the present invention in any form, and all technical solutions obtained by equivalent replacement and the like fall within the protection scope of the present invention.

[0046] The parts not involved in the present invention are the same as the prior art or can be implemented by using the prior art.

Claims

1. A training system for automatic evaluation of tracheal intubation based on a combination of embedded and three-dimensional visualization, characterized in that: The invention comprises a trachea model and an esophagus model simulating the human body structure. The trachea model comprises a glottis, a main trachea, a left main bronchus and a right main bronchus. Metal detection sensors are installed at the glottis, the main trachea, the left main bronchus, the right main bronchus and the esophagus. The metal detection sensors are used to detect whether there is metal passing through the passage of the part where the metal detection sensors are located. The metal detection sensors are connected to an embedded control system to send the detected information to the embedded control system.

2. According to claim 1, a training system for automatic evaluation of tracheal intubation operation based on a combination of embedded and three-dimensional visualization, characterized in that: The embedded control system includes a main controller, a sensor control module, a network module and a display module.

3. The training system for automatic evaluation of tracheal intubation operation based on embedded and three-dimensional visualization according to claim 2 is characterized in that: The embedded controller is connected to the backend server via a WIFI network for data exchange.

4. The training system for automatic evaluation of tracheal intubation operation based on embedded and three-dimensional visualization according to claim 1, characterized in that: When performing a simulated endotracheal intubation operation, the metal detection sensor is used to detect, collect and record data. The system analyzes which part of the metal detection sensor the metal catheter passes through. If it passes through the glottis and trachea, the result is correct. If it passes through the main bronchus, the result is not inserted too deep. If it passes through the esophagus, the result is wrong.

5. The training system for automatic evaluation of tracheal intubation operation based on embedded and three-dimensional visualization according to claim 1, characterized in that: The metal detection sensor determines whether it is triggered by detecting changes in inductance, thereby determining the location of the cannula; the embedded control system obtains the message that the metal detection sensor is triggered through a pin interrupt event, and transmits the cannula location data to the server, and the server controls the three-dimensional application to play different animations to achieve intuitive and timely effect display.

6. The training system for automatic evaluation of tracheal intubation operation based on embedded and three-dimensional visualization according to claim 1, characterized in that: Plastic materials are used to simulate the glottis, trachea, main bronchi and esophagus, silicone materials are used to simulate skin and muscle tissue, and the overall structure simulates the basic structure of the human body.

7. A training method for automatic evaluation of tracheal intubation based on a combination of embedded and three-dimensional visualization, characterized in that: The training steps are: Step 1: Start the camera and adjust the camera angle to a suitable angle to fully capture the operation area; Step 2: Open the web program and log in to the endotracheal intubation 3D training platform with your account and password. After logging in, check whether the camera is shooting normally. Step 3, opening the embedded controller on the endotracheal intubation simulator; Step 4. After completing the above operations, click the start button on the page and then start training. During the operation, the metal detection sensors installed on the simulated human glottis, trachea, left main bronchus, right main bronchus and esophagus will detect the location of the metal intubation tube, and then the embedded controller will transmit the current information to the background server through the network; Step 5: After each training session, statistical records of the data are made; the training video is automatically saved for later playback.

8. A training method for automatic evaluation of tracheal intubation operation based on a combination of embedded and three-dimensional visualization according to claim 7, characterized in that: By distinguishing the material of the model from the material of the catheter used for endotracheal intubation, conditions are created for the catheter to be detected using a metal detection sensor.

9. A training method for automatic evaluation of tracheal intubation operation based on a combination of embedded and three-dimensional visualization according to claim 7, characterized in that: The operating catheter is detected by using a metal detection sensor to distinguish and determine the specific position of the model where the catheter is located.

10. A training method for automatic evaluation of tracheal intubation operation based on a combination of embedded and three-dimensional visualization according to claim 9, characterized in that: The following criteria are used to distinguish the operation results: (1) Glottal triggering: the tube begins to enter the main trachea, which is a normal operation; (2) Tracheal triggering: the tube is located in the main trachea, which is a normal operation; (3) Left main bronchus and right main bronchus triggering: the tube passes through the main trachea and enters the bronchus, which is an over-operation; (4) Esophageal triggering: the tube does not enter the main trachea but enters the esophagus, which is an incorrect operation.

Images