Ultrasound-guided surgical training simulation system and method

Abstract

An ultrasound-guided surgical training simulation system includes a main body, a display device, an image sensor, a storage medium, and a processor. The image sensor senses images of a hand positioning a model on a base and images of a hand inserting surgical instruments into the model. The storage medium stores a standard database and a plurality of modules; the standard database stores a standard procedure. The processor accesses and executes these modules, which include an image processing module and a scoring module. The image processing module controls the display device to display images of the hand positioning the model on the base in a positioning screen, and also controls the display device to display images of the hand inserting surgical instruments into the model in a surgical simulation screen. The scoring module scores the insertion of surgical instruments into the model according to the standard procedure and generates a score result.

Claims

1. An ultrasound-guided surgical training simulation system, comprising: One main body, designed to be worn on the user's head; A display device, disposed on the main body, is used to display a positioning screen, a surgical simulation screen, and a scoring screen. The positioning screen includes a user's hand, a model, and a base. The model corresponds to a specific part of the human body. The surgical simulation screen includes the model simulating a specific part of the human body, one of the user's hands holding an ultrasound probe, the other hand holding a surgical instrument, and an ultrasound image of the specific part of the human body sensed by the ultrasound probe. The scoring screen includes a scoring result. An image sensor, disposed on the main body, is used to sense the image of the user's hand placing the model on the base for positioning, and to sense the image of the user's hand inserting the surgical instrument into the model. A storage medium, disposed in the main body, stores a standard database and a plurality of modules. The standard database stores a standard procedure, which includes operation paths, action sequences, angles, and positions. A processor, disposed in the main body, is electrically connected to the display device, the image sensor, and the storage medium, accesses and executes the modules, and the modules include: An image processing module controls a display device to display an image of the user's hand placing the model on the base in the positioning screen, based on an image of the user's hand placing the model on the base. It also controls the display device to display an image of the user's hand inserting the surgical instrument into the model in the surgical simulation screen, and displays the insertion of the surgical instrument into a specific part of the human body in the ultrasound image, based on an image of the user's hand inserting the surgical instrument into the model. A scoring module scores the operation path, action sequence, angle, and position of the surgical instrument insertion into the model, as well as the task completion time and the number of safety violations, based on the standard procedure, and generates the scoring result.

2. The ultrasound-guided surgical training simulation system as described in claim 1, wherein, The scoring module determines whether the angle and position of the surgical instrument inserted into a specific part of the human body are close to a danger zone based on the angle and position of the standard procedure; if so, the scoring module generates a warning message, and the image processing module controls the display device to display the warning message in the surgical simulation screen.

3. The ultrasound-guided surgical training simulation system as described in claim 1, wherein, The scoring module determines whether the angle and position of the surgical instrument inserted into a specific part of the human body are close to a danger zone based on the angle and position of the standard procedure; if so, the scoring module adjusts the scoring result.

4. The ultrasound-guided surgical training simulation system as described in claim 1, wherein, The storage medium stores a suggested path database, which stores a suggested path; wherein the image processing module controls the display device to display the suggested path in the ultrasound image.

5. The ultrasound-guided surgical training simulation system as described in claim 1, wherein, The storage medium stores an anatomical structure database, which stores anatomical structure information, including the tissue names of specific parts of the human body; wherein, the image processing module controls the display device to annotate the tissue names of specific parts of the human body with text in the ultrasound image based on the anatomical structure information.

6. A method for simulating ultrasound-guided surgery training, comprising the following steps: displaying a positioning screen, wherein, The positioning screen includes the user's hand, a model, and a base, the model corresponding to a specific part of the human body; an image of the user's hand placing the model on the base; and an image of the user's hand placing the model on the base, displayed in the positioning screen; switching to a surgical simulation screen, wherein the surgical simulation screen includes the model simulating a specific part of the human body, one of the user's hands holding an ultrasound probe, the user's other hand holding a surgical instrument, and an ultrasound image of the ultrasound probe sensing the specific part of the human body; an image of the user's hand inserting the surgical instrument into the model; and an image of the user's hand inserting the surgical instrument into the model, displayed in the surgical simulation screen, and the ultrasound image showing the surgical instrument inserted into the specific part of the human body; The operation path, sequence of actions, angle and position of the surgical instrument insertion into the model are scored according to a standard procedure, as well as the task completion time and the number of safety violations, and a score result is generated; and the process is switched to a score screen, which contains the score result.

7. The ultrasound-guided surgical training simulation method as described in claim 6, wherein, The steps for generating the rating result include: determining whether the angle and position of the surgical instrument inserted into a specific part of the human body is close to a danger zone based on the angle and position of the standard procedure; if so, generating a warning message and displaying the warning message in the surgical simulation screen.

8. The ultrasound-guided surgical training simulation method as described in claim 6, wherein, The steps to generate the rating result include: determining whether the angle and position of the surgical instrument inserted into a specific part of the human body is close to a danger zone based on the angle and position of the standard procedure; if so, adjusting the rating result.

9. The ultrasound-guided surgical training simulation method as described in claim 6, wherein, The step of sensing an image of the user's hand inserting the surgical instrument into the model includes displaying a suggested path in the ultrasound image.

10. The ultrasound-guided surgical training simulation method as described in claim 6, wherein, The steps of sensing the user's hand to insert the surgical instrument into the model include: labeling the tissue name of the specific part of the human body in the ultrasound image using text based on the tissue name of the specific part of the human body according to anatomical information.

Images