Fluoroscopy image simulator device for surgical education training and operating method thereof

Abstract

A projection image simulator device for surgical skill training and a method of operating the same are disclosed. The projection image simulator device for surgical skill training may include an organ model through which light can pass, a position adjustment unit for adjusting the position of the organ model, a light panel for outputting light toward the organ model, a camera for acquiring an image captured by the light that has passed through the organ model, a processor for preprocessing the image acquired by the camera to generate a simulated image of the projection image, and an image output unit for outputting the generated simulated image through a display.

Description

Technology Field

[0001] The embodiments relate to a projection image simulator device for surgical skill training and a method of operating the same. Background Technology

[0003] With the recent development of diverse and advanced medical devices, clinical skills training for medical professionals is becoming increasingly important. While medical professionals can improve their proficiency through repetitive training, the opportunities and time available for inexperienced practitioners to acquire these skills are limited due to the nature of the medical field. Although the government and local authorities operate clinical skills training centers to provide spaces and opportunities for free and realistic training, establishing new environments equipped with simulators capable of training on the increasing variety of medical devices resulting from technological advancement entails significant costs and spatial constraints.

[0004] In particular, for minimally invasive surgeries such as interventional procedures that use thin tubes under real-time image guidance using fluoroscopy or ultrasound, equipment and space for training are even more lacking. For medical devices that use radiation to verify the internal structure and function of the human body, such as fluoroscopy, there are difficulties in considering not only the cost of purchasing imaging equipment but also the issue of radiation exposure. Accordingly, there is a need for a configuration proposal that can output image quality similar to existing devices using only simple camera footage, without the need for expensive devices including radiation equipment. means of solving the problem

[0006] A projection image simulator device for surgical skill training according to an exemplary embodiment may include an organ model through which light can pass, a position adjustment unit for adjusting the position of the organ model, a light panel for outputting light toward the organ model, a camera for acquiring an image of the light transmitted through the organ model, a processor for generating a simulated image of the projection image by preprocessing the image acquired by the camera, and an image output unit for outputting the generated simulated image through a display.

[0007] The position adjustment unit may include a rail and a long-term model mounted on at least one of the first side and the second side of the light panel, and a long-term model mounting unit mounted on the rail.

[0008] The long-term model mounting section may include a long-term model position adjustment section for adjusting the position of the long-term model, one or more long-term model coupling sections to which the long-term model is coupled, and a fixing section (136) for fixing the long-term model mounting section on a rail.

[0009] The rail can be arranged in a straight line on at least one of the first side and the second side of the light panel.

[0010] The organ model mounting part may be combined with a surgical tool mounting part for mounting a surgical tool on which a surgical procedure is used for the organ model.

[0011] The above-described projection image simulator device may further include a camera position adjustment unit for adjusting the position of the camera.

[0012] The camera position adjustment unit may include a rail positioned at the top of the light panel, a fixing part fixed at a position on the rail, and a connecting part that connects the fixing part and the camera to which the camera is coupled.

[0013] The processor can generate a simulated image by converting an image acquired by a camera into a grayscale image.

[0014] A method of operation of a projection image simulator device, comprising a light-transmittable organ model, a position adjustment unit for adjusting the position of the organ model, a light panel, a camera, a processor, and an image output unit according to an exemplary embodiment, may include the operation of outputting light toward the organ model through the light panel, the operation of acquiring an image of the light transmitted through the organ model through the camera, the operation of the processor preprocessing the image acquired by the camera to generate a simulated image of the projection image, and the operation of outputting the generated simulated image through a display.

[0015] The operation of generating a simulated image may include the operation of generating a simulated image by converting an image acquired by a camera into a grayscale image. Brief explanation of the drawing

[0017] FIG. 1 is a drawing for explaining the configuration of a projection image simulator device according to one embodiment. FIG. 2 is a drawing for explaining the light panel and rail of a projection image simulator device according to one embodiment. FIG. 3 is a drawing for explaining the long-term model mounting portion of a projection image simulator device according to one embodiment. FIG. 4 is a diagram illustrating the use of a projection image simulator device according to one embodiment for skill training. FIG. 5 is a flowchart illustrating the operation method of a projection image simulator device according to one embodiment. Specific details for implementing the invention

[0018] Hereinafter, embodiments are described in detail with reference to the attached drawings. However, various modifications may be made to the embodiments, and thus the scope of the patent application is not limited or restricted by these embodiments. It should be understood that all modifications, equivalents, and substitutions to the embodiments are included within the scope of the rights.

[0019] The terms used in the embodiments are for illustrative purposes only and should not be interpreted as intended to be limiting. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprising" or "having" are intended to indicate the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0020] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the embodiments pertain. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0021] In addition, when describing with reference to the attached drawings, identical components are assigned the same reference numeral regardless of drawing symbols, and redundant descriptions thereof are omitted. In describing the embodiments, if it is determined that a detailed description of related prior art could unnecessarily obscure the essence of the embodiments, such detailed description is omitted.

[0022] In addition, terms such as first, second, A, B, (a), (b), etc., may be used when describing the components of the embodiments. These terms are intended only to distinguish the components from other components, and the nature, order, or sequence of the components is not limited by the terms. Where it is stated that a component is "connected," "combined," or "connected" to another component, it should be understood that the component may be directly connected or connected to the other component, but that another component may also be "connected," "combined," or "connected" between each component.

[0023] Components included in any one embodiment and components having common functions shall be described using the same names in other embodiments. Unless otherwise stated, the description in any one embodiment may also apply to other embodiments, and specific descriptions shall be omitted to the extent of overlap.

[0025] FIG. 1 is a drawing for explaining the configuration of a projection image simulator device according to one embodiment.

[0026] The fluoroscopic image simulator device according to the embodiment relates to a medical simulator device, and more specifically, to a fluoroscopic image simulator device used in interventional procedures. An interventional procedure refers to a procedure in which a path is created to a diseased area using a tool such as a needle or catheter under real-time image guidance using fluoroscopy or ultrasound. The fluoroscopic image simulator device can perform a fluoroscopic examination simulation function installed within a human body model during an interventional procedure, which transmits information regarding the anatomical structure and function of the human body part, as well as the position and direction of the surgical tool, to a user (e.g., medical professional, trainee) in real-time via a display.

[0027] Referring to FIG. 1, the projection image simulator device (100) may include a long-term model (110), a position adjustment unit, a light panel (120), a camera (140), a processor (170), and an image output unit (180).

[0028] The organ model (110) can transmit light. The organ model (110) may be a model of a body part to be viewed through a fluoroscopic image. The organ model (110) may be a model of a body part contained within the human body (105) and may be made transparent to make it easy to check the inside. The organ model (110) may be produced by 3D printing using a transparent material. The organ model (110) may be a model of various organs, such as the heart, stomach, large intestine, uterus, blood vessels, etc. The user can perform surgical training by placing the organ model (110) suitable for the surgical skill to be trained on the fluoroscopic image simulator device (100).

[0029] The user can adjust the position of the organ model (110) through a position adjustment unit to which the organ model (110) is coupled. In one embodiment, the position adjustment unit may include a rail (125) positioned on at least one of the first side and the second side of the light panel (120), and an organ model mounting unit (130) positioned on the rail (125) to which the organ model (110) is mounted. The organ model mounting unit (130) may include an organ model position adjustment unit (132) for adjusting the position of the organ model (110), one or more organ model coupling units (134) to which the organ model (110) is coupled, and a fixing unit (136) for fixing the organ model mounting unit (130) on the rail (125). The user can perform surgical training by replacing the organ model (110) through the organ model mounting unit (130).

[0030] The light panel (120) can emit light toward the organ model (110). The light panel (120) may include one or more light sources (e.g., point light source, line light source, surface light source).

[0031] The camera (140) can acquire an image of light transmitted through the organ model. In the image acquired by the camera (140), for example, the organ model (110) and the surgical tool (160) may appear superimposed, and can be used as a simulated image for surgical training (e.g., the simulated image of FIG. 4). The camera (140) may be, for example, a color camera, a grayscale camera, an infrared camera, or a fluorescent camera, but is not limited thereto.

[0032] In one embodiment, the projection image simulator device (100) may further include a camera position adjustment unit for adjusting the position of a camera (140). The camera position adjustment unit may include a rail (150) positioned on the top of a light panel (120), a fixing part (152) fixed at a position on the rail (150), and a connecting part (154) to which the camera (140) is coupled and which connects the fixing part (152) and the camera (140).

[0033] In one embodiment, the user can change the position of the camera (140) on the rail (150) so that the long-term model (110) can be photographed from various positions / directions through the camera (140). In one embodiment, the fixed part (152) can move along the rail (150) and change its position, and accordingly, the connecting part (154) and the camera (140) coupled to the fixed part can also move together.

[0034] The processor (170) can preprocess an image acquired by the camera (140) to generate a simulated image of the projection image (e.g., the simulated image of FIG. 4). The processor (170) can generate a simulated image of the projection image similar to an X-ray image or an ultrasound image (e.g., the simulated image of FIG. 4) through image preprocessing. The processor (170) may include one or more processors and can perform image preprocessing by executing a series of instructions contained in memory. Image preprocessing may include, but is not limited to, resolution conversion, image size conversion, cropping, rotation, contrast and brightness conversion, in addition to image processing such as converting to grayscale.

[0035] The image output unit (180) can output the generated simulated image (e.g., the simulated image of FIG. 4) through a display. The display may include, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display.

[0036] The proposed fluoroscopic image simulator device (100) enables efficient and repetitive procedural training by utilizing a long-term model that can be manufactured in various forms, and can simulate an actual procedural environment. Users can improve their procedural skills by receiving images similar to actual procedural images without the burden of the cost of the radiation device or radiation exposure caused by the radiation device. In addition, the fluoroscopic image simulator device can be utilized as a key tool in the evaluation of medical personnel's use in an environment similar to the medical environment required in the usability test, which is mandatory during the medical device development process.

[0038] FIG. 2 is a drawing for explaining the light panel and rail of a projection image simulator device according to one embodiment.

[0039] The light panel (120) can emit light toward the organ model (110). In one embodiment, the light panel (120) may be positioned below the organ model (110). The light panel (120) allows the light passing through the organ model (110) to project human anatomical shadows, enabling a camera (e.g., the camera of FIG. 1) to obtain an image similar to the organ image.

[0040] The rail (125) may be arranged in a straight line on at least one of the first side and the second side of the light panel (120). In one embodiment, to apply the appropriate anatomical position for each organ model (110), the user may use the rail (125) to change the position of the organ model (e.g., the organ model of FIG. 1).

[0041] The rail (150) may be arranged in a straight line on the top of the light panel (120), for example, or in a semicircular shape that can provide a 180-degree rotation function, but is not limited thereto.

[0043] FIG. 3 is a drawing for explaining the long-term model mounting portion of a projection image simulator device according to one embodiment.

[0044] The long-term model mounting section (130) may include a long-term model position adjustment section (132), one or more long-term model coupling sections (134), and a fixing section (136). The user can adjust the position of the long-term model (110) through the long-term model position adjustment section (132) and can combine the long-term model (110) with the long-term model mounting section (130) through the long-term model coupling section (134). The user can fix the long-term model mounting section (130) on a rail (125) through the fixing section (136).

[0045] In one embodiment, the fixed part (136) can move along the rail (125) and change its position, and accordingly, the long-term model position adjustment part (132) and the long-term model coupling part (134) coupled with the fixed part (136) can also move together. The long-term model position adjustment part (132) can be implemented in a rotatable form at both ends of the fixed part (136) so as to finely adjust the position of the long-term model (110). The long-term model coupling part (134) may be made of a deformable material so as to be able to fix various forms of the long-term model (110) at one of the two ends of the long-term model position adjustment part (132). The user can fix various forms of the long-term model (110) by adjusting the height and size of the long-term model coupling part (134).

[0046] A surgical tool mounting portion (138) for mounting a surgical tool (160) on which a surgical procedure is performed on the organ model (110) may be coupled to the organ model mounting portion (130). In one embodiment, the surgical tool mounting portion (138) may be placed on the fixing portion (136). The surgical tool (160) may be fixed by means such as tightening a fixing screw while passing through the inside of the surgical tool mounting portion (138).

[0048] FIG. 4 is a diagram illustrating the use of a projection image simulator device according to one embodiment for skill training.

[0049] Referring to FIG. 4, a user can perform surgical training using a projection image simulator device (100). The user can select some of the various types of organ models to be used for surgical training and can combine the selected organ model (110) with an organ model position adjustment unit (132) that can adjust the position of the organ model (110).

[0050] The user can move the fixing part (136) on a rail (125) positioned on at least one of the first side and the second side of the light panel (120) to move the long-term model position adjustment part (132) and the long-term model coupling part (134) together with the fixing part (136). The user can fix the long-term model (110) to the long-term model mounting part (130) by adjusting the height and size of the long-term model coupling part (134). The fixing part (136) for fixing the position of the long-term model position adjustment part on the rail can be moved and fixed on the rail (125). The long-term model position adjustment part (132) can be rotated, and the height / direction of the long-term model coupling part (134) can be adjusted.

[0051] The user can fix the surgical tool (160) used on the organ model (110) by passing the surgical tool (160) through the surgical tool mounting part (138). The user can supply power to the light panel (120) so that the light panel (120) emits light toward the organ model (110) and view an image of the light passing through the organ model (110) through the camera (140).

[0052] The user can change the position of the camera (140) using a rail (150) to capture a three-dimensional image of the organ model (110). The user can move the fixed part (152) on the rail (150), which is arranged in a semicircular shape and can provide a 180-degree rotation function, thereby moving the connecting part (154) connected to the fixed part (152) and the camera (140) combined with the connecting part (154) together. The image acquired by the camera (140) is transmitted to a processor (170), and the processor (170) can preprocess the image to generate a simulated image (410) for the perspective image. The image output unit (180) can output the simulated image (410) generated by the processor (170) through a display. The user can train the surgical procedure while checking the simulated image (410) output through the display. The simulated image (410) may show how the surgical tool (160) passes through the organ model (110) by user operation.

[0054] FIG. 5 is a flowchart illustrating a method of operation of a projection image simulator device according to one embodiment. In one embodiment, at least one of the operations of FIG. 5 may be performed simultaneously or in parallel with other operations, and the order of the operations may be changed. Additionally, at least one of the operations may be omitted, and other operations may be additionally performed.

[0055] In operation (510), the projection image simulator device (100) can output light toward the organ model (110) through the light panel (120). The light output through the light panel (120) can penetrate the interior of the organ model (110) and project human anatomical shadows.

[0056] In operation (520), the projection image simulator device (100) can acquire an image of light transmitted through the organ model (110) through the camera of the projection image simulator device (e.g., the camera (140) of FIG. 1). The projection image simulator can acquire an image through the camera (140), such as a color camera, a gray camera, an infrared camera, or a fluorescent camera. In one embodiment, the camera (140) can change its position on a rail (e.g., the rail (150) of FIG. 1) arranged in a semicircular shape, which can provide a 180-degree rotation function, to capture a three-dimensional image of the organ model (110).

[0057] In operation (530), the projection image simulator device (100) can generate a simulated image (410) for the projection image by preprocessing the image acquired by the camera (140). In one embodiment, the projection image simulator device (100) can generate the simulated image (410) by converting the image acquired by the camera (140) into a grayscale image.

[0058] The projection image simulator device (100) can generate a projection image similar to an X-ray image or an ultrasound image through image preprocessing. Image preprocessing may include, for example, resolution conversion, image size conversion, cropping, rotation, contrast and brightness conversion, in addition to image processing that converts to grayscale, but is not limited thereto.

[0059] In operation (540), the projection simulator device (100) can output the generated simulation image (410) through a display. The projection image simulator device (100) can output the simulation image (410) through a display such as, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a micro-electromechanical system (MEMS) display, or an electronic paper display. The operation of the surgical tool (160) on the user's organ model (110) can be captured in real time by the camera (140) to generate a simulation image (410) and then output through the display. The user can train the surgical procedure while checking the simulation image (410) output through the display.

[0061] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiment, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0062] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, or computer storage medium or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0063] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0064] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 A fluoroscopic image simulator device for surgical training comprises: an organ model through which light can pass; a position adjustment unit for adjusting the position of the organ model; a light panel for outputting light toward the organ model; a camera for acquiring an image of the light transmitted through the organ model; a processor for preprocessing the image acquired by the camera to generate a simulated image of the fluoroscopic image; and an image output unit for outputting the generated simulated image through a display, wherein the position adjustment unit comprises: a rail disposed on at least one of a first side and a second side of the light panel; and an organ model mounting unit disposed on the rail on which the organ model is mounted, wherein the organ model mounting unit comprises: a fixing unit for fixing the organ model mounting unit at one or more positions corresponding to appropriate anatomical positions of the organ model while moving along the rail; an organ model position adjustment unit coupled to the fixing unit and implemented in a rotatable form to adjust the position of the organ model at the end of the fixing unit; and an organ model coupling unit composed of a deformable material to be coupled to the organ model at the end of the organ model position adjustment unit. A fluoroscopic image simulator device comprising a surgical tool mounting portion disposed on the fixed portion and for mounting a surgical tool used for surgical procedures on the organ model by fixing it in place through a method of tightening a fixing screw. Claim 2 delete Claim 3 delete Claim 4 A projection image simulator device according to claim 1, wherein the rail is arranged in a straight line on at least one of the first side and the second side of the light panel. Claim 5 delete Claim 6 A projection image simulator device according to claim 1, further comprising a camera position adjustment unit for adjusting the position of the camera. Claim 7 In claim 6, the camera position adjustment unit comprises: a rail disposed on the top of the light panel; a fixing part fixed at a position on the rail; and a connecting part to which the camera is coupled and which connects the fixing part and the camera, in a projection image simulator device. Claim 8 A projection image simulator device according to claim 1, wherein the processor generates the simulated image by converting the image acquired by the camera into a grayscale image. Claim 9 A method of operation of a projection image simulator device comprising an organ model through which light can pass, a position adjustment unit for adjusting the position of said organ model, a light panel, a camera, a processor, and an image output unit, the method comprising: an operation of outputting light toward the organ model through the light panel; an operation of acquiring an image of the light transmitted through said organ model through the camera; an operation in which the processor preprocesses the image acquired by the camera to generate a simulated image of the projection image; and an operation of outputting the generated simulated image through a display, wherein the position adjustment unit comprises: a rail disposed on at least one of a first side and a second side of the light panel; and an organ model mounting unit disposed on the rail on which the organ model is mounted, wherein the organ model mounting unit comprises: a fixing unit for fixing the organ model mounting unit at one or more positions corresponding to appropriate anatomical positions of said organ model while moving along the rail; an organ model position adjustment unit coupled to the fixing unit and implemented in a rotatable form to adjust the position of said organ model at the end of the fixing unit; and an organ model coupling unit composed of a deformable material to be coupled to said organ model at the end of the organ model position adjustment unit. A method of operation comprising a surgical tool mounting portion disposed on the fixed portion and for mounting a surgical tool used for a surgical procedure on the organ model by fixing it by tightening a fixing screw. Claim 10 delete Claim 11 delete Claim 12 In claim 9, the operation of generating the simulated image includes the operation of generating the simulated image by converting an image acquired by the camera into a grayscale image.

Images