Virtual environment-based incision simulation modeling device

The virtual environment-based incision simulation modeling device addresses the computational inefficiencies of conventional medical surgery simulations by using a layered virtual object model and feedback control unit, resulting in faster and more cost-effective incision simulations with enhanced realism.

WO2025121679A1PCT designated stage expired Publication Date: 2025-06-12KOREA UNIV RES & BUSINESS FOUND
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/017150
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-07
Filing Date
2024-11-04
Publication Date
2025-06-12

AI Technical Summary

Technical Problem

Conventional medical surgery simulations in virtual environments require significant computational resources to accurately model incisions, leading to long rendering times and increased infrastructure costs.

Method used

A virtual environment-based incision simulation modeling device that includes a memory unit for storing modeling data for a virtual object with three layers and a virtual medical tool, a virtual space providing unit, a virtual medical tool control unit, and a feedback control unit that generates feedback for the virtual object and tool upon contact, allowing for efficient simulation of incisions with reduced computational effort.

Benefits of technology

The solution enables faster response times and reduced infrastructure costs by modeling incisions with less computational effort, while maintaining realistic simulation immersion through haptic feedback and visual effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024017150_12062025_PF_FP_ABST
    Figure KR2024017150_12062025_PF_FP_ABST
Patent Text Reader

Abstract

The present specification discloses a virtual environment-based incision simulation modeling device. The incision simulation modeling device according to the present specification includes: a memory unit for storing modeling data for a virtual object that has three layers and modeling data for a virtual medical tool; a virtual space providing unit for providing a virtual space in which the virtual object and the virtual medical tool are arranged; a virtual medical tool control unit for controlling the movement of the virtual medical tool in the virtual space according to an external input signal; and a feedback control unit for generating feedback on the virtual object or the virtual medical tool when the virtual object and the virtual medical tool come into contact with each other in the virtual space.
Need to check novelty before this filing date? Find Prior Art

Description

Virtual environment-based incision simulation modeling device

[0001] The present invention relates to a cutting simulation modeling device, and more particularly, to a virtual environment-based cutting simulation modeling device.

[0002] The material described in this section merely provides background information on the embodiments described herein and does not necessarily constitute prior art.

[0003] With the advancement of virtual environment technology, medical surgery simulation technology in a virtual environment is being developed to enhance the surgical skills of doctors with limited clinical experience. To enhance the immersion of trainees in these medical surgery simulations, it is necessary to realistically replicate the physical phenomena occurring during actual medical surgery in a virtual environment.

[0004] Figure 1 illustrates a method for implementing incision of a wound in a conventional medical surgery simulation.

[0005] Referring to Fig. 1, in conventional medical surgery simulations, a virtual 3D affected area object is implemented as a plurality of mesh shapes formed by cloud points. In order to implement an incision of a patient's affected area performed in an actual medical surgery site, a computer calculates the intersection points between the actual cutting curve of the virtual medical tool and the lines forming the mesh (Fig. 1 (a)). Thereafter, the computer calculates a sampled cutting curve connecting each intersection point. Thereafter, the computer performs a computational process of reconstructing the existing mesh shape into a plurality of sub-meshes using the sampled cutting curve and each intersection point.

[0006] Conventional medical surgery simulations require a relatively large amount of computation to simulate the incisions made on a patient's affected area. This leads to long rendering times for the incisions in a virtual environment, slowing down response times, and increasing the costs of building and maintaining the infrastructure.

[0007] [Prior Art Literature]

[0008] [Non-patent literature]

[0009] (Non-patent Document 1) Virtual Reality Simulator for Training in Myringotomy with Tube Placement, Caiwen Huang et al.. 2016, J. Med. Biol. Eng.

[0010] The purpose of this specification is to provide a virtual environment-based incision simulation modeling device.

[0011] This specification is not limited to the above-mentioned tasks, and other tasks not mentioned will be clearly understood by those skilled in the art from the description below.

[0012] The incision simulation modeling device according to the present specification for solving the above-described problem may include a memory unit storing modeling data for a virtual object having three layers and modeling data for a virtual medical tool; a virtual space providing unit providing a virtual space in which the virtual object and the virtual medical tool are arranged; a virtual medical tool control unit controlling movement of the virtual medical tool within the virtual space according to an external input signal; and a feedback control unit generating feedback for the virtual object or the virtual medical tool when the virtual object and the virtual medical tool come into contact within the virtual space.

[0013] According to one embodiment of the present specification, the three layers of the virtual object may include a first layer forming an incision target; a second layer forming a non-incision target; and a third layer for generating a vertical repulsive force of the virtual medical tool.

[0014] At this time, the second layer is placed between the first layer and the third layer, and the second layer can be formed with an area corresponding to the first layer as a blank area.

[0015] According to one embodiment of the present specification, the first layer has a mesh shape formed of cloud points, and the feedback control unit can annihilate the mesh of an area of ​​the first layer that is in contact with the virtual medical tool.

[0016] According to one embodiment of the present specification, the feedback control unit can generate a feedback signal for a movement resistance of the virtual medical tool when the virtual medical tool comes into contact with the first layer.

[0017] According to one embodiment of the present specification, the feedback control unit can move the position of a cloud point adjacent to a mesh that has disappeared in contact with the virtual medical tool in the area of ​​the first layer by a preset amount in the direction in which the virtual medical tool has moved.

[0018] According to one embodiment of the present specification, the feedback control unit can generate feedback by modeling the outflow of body fluid when the mesh object is destroyed.

[0019] According to one embodiment of the present specification, the feedback control unit can generate a feedback signal that restricts entry of the virtual medical tool when the virtual medical tool comes into contact with the third layer.

[0020] The incision simulation modeling device according to the present specification may be a component of an incision simulation system, including a virtual medical tool control device that outputs a movement signal of the virtual medical tool to a virtual medical tool control unit of the incision simulation modeling device.

[0021] According to one embodiment of the present specification, the virtual medical tool control device may include an incision signal generation unit that outputs an incision signal to the incision simulation modeling device.

[0022] According to one embodiment of the present specification, the virtual medical tool control device may include a haptic providing unit that provides a haptic response to a user by a signal output from a feedback control unit of the incision simulation modeling device.

[0023] The incision simulation system according to the present specification may further include a display device that displays a virtual space provided by a virtual space providing unit of the incision simulation modeling device, the virtual object, and a virtual medical tool.

[0024] According to one embodiment of the present specification, the display device may be a display of a predetermined form that is mounted on a user's head.

[0025] Other specific details of the present invention are included in the detailed description and drawings.

[0026] According to one aspect of the present specification, by implementing only the area of ​​the first layer forming the incision target as a mesh shape formed by cloud points, a virtual object can be modeled using relatively less memory compared to conventional techniques.

[0027] According to another aspect of the present disclosure, by destroying the mesh of the area in contact with the virtual medical tool, an incision simulation can be modeled with a relatively smaller amount of computation compared to conventional techniques.

[0028] According to another aspect of the present specification, the simulation can be modeled with a smaller amount of computation than before, thereby making the simulation relatively faster than before.

[0029] According to another aspect of the present disclosure, modeling of incision simulations can be achieved with less computational effort than before, resulting in relatively lower costs for infrastructure construction, use and / or maintenance.

[0030] The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0031] Figure 1 illustrates a method for implementing incision of a wound in a conventional medical surgery simulation.

[0032] FIG. 2 is a block diagram of a cutting simulation modeling device according to one embodiment of the present specification.

[0033] Figure 3 shows an image of the eardrum of a human body.

[0034] Figure 4 is an example image of modeling data of a virtual object loaded into a modeling program.

[0035] Figure 5 is an example image of incision simulation modeling according to the present specification.

[0036] Figure 6 is another example image of incision simulation modeling according to the present specification.

[0037] Figure 7 is another example image of the incision simulation modeling according to the present specification.

[0038] FIG. 8 is a block diagram of a cutting simulation system according to one embodiment of the present specification.

[0039] FIG. 9 is a block diagram of a cutting simulation system according to another embodiment of the present specification.

[0040] The advantages and features of the invention disclosed in this specification, and the methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, this specification is not limited to the embodiments disclosed below and may be implemented in various different forms. These embodiments are provided only to ensure that the disclosure of this specification is complete and to fully inform those of ordinary skill in the art (hereinafter referred to as "skilled workers") of the scope of this specification, and the scope of rights of this specification is defined only by the scope of the claims.

[0041] The terminology used herein is for the purpose of describing embodiments and is not intended to limit the scope of the present disclosure. In this specification, singular forms also include plural forms, unless specifically stated otherwise. As used herein, the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the components mentioned.

[0042] Throughout the specification, the same reference numerals refer to the same elements, and the term "and / or" includes each and every combination of the elements mentioned. Although terms such as "first," "second," etc. are used to describe various elements, these elements are not limited by these terms. These terms are used only to distinguish one element from another. Therefore, it should be understood that a first element mentioned below may also be a second element within the technical scope of the present invention.

[0043] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those skilled in the art to which this specification pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0044] Spatially relative terms such as "below," "beneath," "lower," "above," and "upper" can be used to easily describe the relationship between one component and other components as depicted in the drawings. Spatially relative terms should be understood to include different orientations of the components during use or operation in addition to the orientations depicted in the drawings. For example, if a component depicted in the drawings were flipped over, a component described as "below" or "beneath" another component could instead be "above" the other component. Thus, the exemplary term "below" can include both the above and below orientations. Components can also be oriented in other directions, and thus spatially relative terms can be interpreted accordingly.

[0045] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0046] FIG. 2 is a block diagram of a cutting simulation modeling device according to one embodiment of the present specification.

[0047] Referring to FIG. 2, an incision simulation modeling device (10) according to one embodiment of the present specification may include a memory unit (100), a virtual space providing unit (110), a virtual medical tool control unit (120), and a feedback control unit (130).

[0048] The above memory unit (100) can store modeling data for a virtual object having three layers and modeling data for a virtual medical instrument. The virtual object may correspond to a virtual affected area modeled for incision simulation. In addition, the virtual object may correspond to a virtual human body structure including a specific affected area modeled for incision simulation.

[0049] According to one embodiment of the present specification, the virtual object may correspond to a virtual tympanic membrane modeled for myringotomy simulation. In addition, the virtual object may correspond to a virtual human body structure including the tympanic membrane and middle ear region modeled for myringotomy simulation. In addition, the virtual object may correspond to a virtual human body structure including the tympanic membrane, external auditory canal, and / or middle ear region modeled for myringotomy simulation. This is merely an example, and the virtual object may vary depending on the type of incision simulation to be implemented in a virtual environment. In addition, the memory unit (100) may store modeling data for at least one virtual object for at least one incision simulation.

[0050] The virtual medical tool may correspond to a virtual myringotomy knife for cutting the virtual eardrum. This is merely an example, and the virtual medical tool may vary depending on the type of surgical incision simulation to be implemented in the virtual environment. Furthermore, the memory unit (100) may store modeling data for at least one virtual medical tool for at least one incision simulation.

[0051] According to one embodiment of the present specification, the three layers of the virtual object may include a first layer forming an incision target, a second layer forming a non-incision target, and a third layer for generating a vertical repulsive force of the virtual medical tool.

[0052] Figure 3 shows an image of the eardrum of a human body.

[0053] Referring to Figure 3, the tympanic membrane can be divided into the anterior superior and posterior superior regions attached to the malleus, and the anterior inferior and posterior inferior regions not attached to the malleus. When performing an actual myringotomy, the anterior inferior and posterior inferior regions are incised to drain the effusion. The anterior refers to the direction toward the face of the human body and the direction toward the back of the head, the superior refers to the direction toward the crown of the head, and the inferior refers to the direction toward the legs.

[0054] In the modeling data of the virtual object stored in the memory unit (100) for the above-mentioned myringotomy simulation, the modeling data for the first layer may correspond to modeling data for the anterior lower and posterior lower regions of the eardrum. The modeling data for the second layer may correspond to modeling data for the anterior upper and posterior upper regions of the eardrum including the malleus. In addition, the modeling data for the second layer may further include modeling data for a portion of the external auditory canal. The modeling data for the third layer may correspond to modeling data for a portion of the inner wall of the middle ear.

[0055] The virtual space providing unit (110) may provide a virtual space in which the virtual objects and virtual medical tools are arranged. The memory unit (100) may further include modeling data for the virtual space. The virtual space providing unit (110) may retrieve the modeling data of the virtual space from the memory unit (100). The virtual space providing unit (110) may render the virtual space using the modeling data of the virtual space.

[0056] Figure 4 is an example image of modeling data of a virtual object loaded into a modeling program.

[0057] Referring to FIG. 4, the modeling data of the virtual object (200) stored in the memory unit (100) may include the first layer (210), the second layer (220), and the third layer (230). The second layer (220) may be positioned between the first layer (210) and the third layer (230). This may mean that the first layer (210), the second layer (220), and the third layer (230) are stacked.

[0058] The first layer (210) may have a relatively largest z-axis coordinate value in the virtual space. The second layer (220) may have a z-axis coordinate value that is next largest after the first layer (210) in the virtual space. The third layer (230) may have a relatively smallest z-axis coordinate value in the virtual space. This may mean that the first layer (210), the second layer (220), and the third layer (230) are stacked on the z-axis of the virtual space.

[0059] The difference between the z-axis coordinate value of the first layer (210) and the z-axis coordinate value of the second layer (220) can be set within a predetermined difference. The difference between the z-axis coordinate value of the second layer (220) and the z-axis coordinate value of the third layer (230) can be set within a predetermined difference.

[0060] The coordinate axes along which the first layer (210), second layer (220), and third layer (230) are stacked in the virtual space may vary depending on the orientation of the virtual object (200), and are not limited by a specific coordinate axes.

[0061] The first layer (210) may overlap the second layer (220). The area of ​​the second layer (220) where the first layer (210) overlaps may be formed as a blank area.

[0062] The shape of the blank area may be identical to the shape of the first layer (210). In addition, the shape of the blank area may be larger than the shape of the first layer (210) by a predetermined size. In addition, the shape of the blank area may be smaller than the shape of the first layer (210) by a predetermined size.

[0063] Figure 5 is an example image of incision simulation modeling according to the present specification.

[0064] Referring to FIG. 5, the virtual object (200) and the virtual medical tool (300) can be placed in the virtual space.

[0065] The above virtual medical tool control unit (120) can control the movement of the virtual medical tool (300) within the virtual space according to an external input signal.

[0066] The above feedback control unit (130) can generate feedback for the virtual object (200) and / or the virtual medical tool (300) when the virtual object (200) and the virtual medical tool (300) come into contact within the virtual space.

[0067] The feedback control unit (130) can determine whether the virtual object (200) and the virtual medical tool (300) are in contact within the virtual space. When the feedback control unit (130) determines that the virtual object (200) and the virtual medical tool (300) are in contact, the feedback control unit (130) can generate visual feedback that changes the shape of the virtual object (200). In addition, the feedback control unit (130) can generate a tactile feedback signal corresponding to a force generated when cutting human tissue with an actual medical tool.

[0068] According to one embodiment of the present specification, the feedback control unit (130) can determine whether the virtual medical tool (300) is in contact with the first layer (210). When the feedback control unit (130) determines that the first layer (210) and the virtual medical tool (300) are in contact, the feedback control unit (130) can generate the visual feedback in the first layer (210). The visual feedback generated in the virtual first layer (210) may mean implementing an incision of human tissue in an actual medical surgical procedure.

[0069] In order to implement the incision of the human tissue, the modeling data of the first layer (210) may correspond to modeling data that creates the first layer (210) in the virtual space as a mesh structure based on cloud points (Fig. 5 (a)). The modeling data of the second layer (220) and the third layer (230) may correspond to surface modeling data. This is an example and is not limited by the modeling method. By creating only the first layer (210) as the mesh structure, the incision simulation modeling device (10) according to the present specification can model a virtual object using relatively less memory than a conventional incision simulation modeling device.

[0070] Referring to (a) of FIG. 5, if the feedback control unit (130) determines that the first layer (210) and the virtual medical tool (300) are not in contact, the feedback control unit (130) may not generate the visual feedback to the first layer (210).

[0071] Referring to (b) of FIG. 5, it can be confirmed that when the virtual object (200) is rendered, the visual feedback by the feedback control unit (130) is not generated in the area corresponding to the first layer (210).

[0072] Referring to (c) of FIG. 5, if the feedback control unit (130) determines that the first layer (210) and the virtual medical tool (300) are in contact, the feedback control unit (130) can generate the visual feedback to the first layer (210). The feedback control unit (130) can generate the visual feedback by removing the area of ​​the first layer (210) that the virtual medical tool (300) is in contact with.

[0073] The feedback control unit (130) may generate information on the coordinate values ​​of the area where the first layer (210) and the virtual medical tool (300) come into contact. The feedback control unit (130) may generate the visual feedback to destroy the mesh of the first layer (210) including the coordinate values ​​of the area. This may mean that the feedback control unit (130) generates the visual feedback to delete data that creates the mesh including the coordinate values ​​of the area in the virtual space. Alternatively, it may mean that the feedback control unit (130) generates the visual feedback to delete data of points that constitute the mesh including the coordinate values ​​of the area.

[0074] Referring to (d) of FIG. 5, when the virtual object (200) is rendered, the area of ​​the first layer (210) that the virtual medical tool (300) came into contact with can be removed by the visual feedback generated by the feedback control unit (130).

[0075] In order to determine whether the first layer (210) and the virtual medical tool (300) are in contact with each other, bounding box collision detection, separating axis theorem, bounding volume hierarchy (BVH), or Gilbert-Johnson-Keerthi (GJK) algorithm, etc. may be used, which are examples and are not limited by a specific algorithm.

[0076] The incision simulation modeling device (10) according to the present specification can perform relatively fewer operations by removing the mesh of the first layer (210) in the area where the virtual medical tool (300) comes into contact, thereby omitting the computational process of reconstructing the mesh into a sub-mesh in a conventional incision simulation device.

[0077] When the area of ​​the first layer (210) that the virtual medical tool (300) contacts is removed, the area of ​​the third layer (230) corresponding to the removed area can be modeled to be visible. At this time, the third layer (230) can be modeled with a color value that is relatively darker than the first layer (210) and the second layer (220). Alternatively, the third layer (230) can be modeled with a color value different from the first layer (210) and the second layer (220). Alternatively, the third layer (230) can be modeled to include a marker of a predetermined shape. This is an example and is not limited by the above methods.

[0078] Figure 6 is another example image of incision simulation modeling according to the present specification.

[0079] Referring to (a) and (b) of FIG. 6, the virtual medical tool (300) can move to the lower right while maintaining contact with the first layer (210). The feedback control unit (130) can eliminate the mesh of the first layer (210) that the virtual medical tool (300) has contacted while moving.

[0080] In addition, the feedback control unit (130) can deform the mesh of the first layer (210) toward the direction in which the virtual medical tool (300) moves. The feedback control unit (130) can move the position of a cloud point adjacent to the mesh that has disappeared by contact with the virtual medical tool (300) by a preset amount in the direction in which the virtual medical tool (300) has moved.

[0081] For example, the virtual medical tool (300) can move downward while maintaining contact with the first layer (210) ((c) of FIG. 6). The feedback control unit (130) can annihilate the mesh of the first layer (210) that is in contact with the virtual medical tool (300) ((d) of FIG. 6). The feedback control unit (130) can select a cloud point adjacent to the annihilated mesh in (d) of FIG. 6. Thereafter, the feedback control unit (130) can move the cloud point by a preset amount in the direction in which the virtual medical tool (300) moved. Using this, the feedback control unit (130) can implement in the virtual object (200) that the cutting surface of the human tissue is pulled in the moving direction of the surgical tool due to the frictional force between the surgical tool and the cutting surface of the human tissue during an actual incision surgery. This is an example and is not limited by a specific moving direction of the virtual medical tool (300).

[0082] In (b) of FIG. 6, when the virtual medical tool (300) moves to the lower right while maintaining contact with the first layer (210), the feedback control unit (130) can generate a tactile feedback signal for the movement resistance of the virtual medical tool (300). The movement resistance may refer to a reaction force that the surgical tool receives from human tissue located in the movement direction during an actual incision surgery. In addition, the movement resistance may correspond to a frictional force that the surgical tool receives from the cut surface of human tissue during an actual incision surgery. In addition, the movement resistance may refer to a net force of the reaction force and the frictional force. In addition, the movement resistance may refer to a net force for all forces acting in the opposite direction to the movement direction of the surgical tool due to the interaction between the surgical tool and human tissue. Referring to (b) of the above-described FIG. 6, the feedback control unit (130) can generate a tactile feedback signal for a movement resistance force acting in the upper left direction opposite to the movement direction of the virtual medical tool (300). This is an example and is not limited to a specific direction.

[0083] The feedback control unit (130) can generate visual feedback by modeling the outflow of body fluid when the mesh of the first layer (210) is destroyed. The memory unit (100) can further include body fluid outflow modeling data. The feedback control unit (130) can retrieve the body fluid outflow modeling data from the memory unit (100). When the mesh of the first layer (210) is destroyed, the feedback control unit (130) can model the body fluid outflow in the area where the mesh is destroyed. In a myringotomy simulation, the body fluid outflow modeling data can correspond to data modeling the outflow of exudate. This is an example and is not limited by the body fluid.

[0084] Figure 7 is another example image of the incision simulation modeling according to the present specification.

[0085] Referring to FIG. 7, the virtual medical tool (300) may pass through a blank area between the first layer (210) and the third layer (230) and come into contact with the third layer (230). When the virtual medical tool (300) comes into contact with the third layer (230), the feedback control unit (130) may generate a tactile feedback signal that restricts the entry of the virtual medical tool (300). The feedback signal may be a signal corresponding to a vertical repulsive force acting in a direction opposite to the entry direction of the virtual medical tool (300).

[0086] The entry direction of the above virtual medical tool (300) may mean a vertical direction from the first layer (210) toward the third layer (230).

[0087] In the above virtual space, the first layer (210) may have a relatively larger z-axis coordinate value than the third layer (230). The entry direction of the virtual medical tool (300) may be a direction in which the z-axis coordinate value becomes relatively smaller.

[0088] During an actual myringotomy, the surgical instrument may incise the tympanic membrane and contact the inner wall of the middle ear. This can create a vertical repulsive force from the inner wall of the middle ear to the surgical instrument.

[0089] When the virtual medical tool (300) comes into contact with the third layer (230) in the myringotomy simulation, the feedback control unit (130) can output a tactile feedback signal corresponding to the vertical repulsive force generated during the actual surgery to the virtual medical tool (300).

[0090] FIG. 8 is a block diagram of a cutting simulation system according to one embodiment of the present specification.

[0091] Referring to FIG. 8, an incision simulation system (1) according to one embodiment of the present specification may include the incision simulation modeling device (10) and the virtual medical tool control device (20). The virtual medical tool control device (20) may output a signal according to the movement of the user to the virtual medical tool control unit (120). The virtual medical tool control unit (120) may receive the movement signal and control the movement of the virtual medical tool (300). The virtual medical tool control device (20) may be a pen-shaped device connected to a plurality of robotic arms or a device having the same shape as an actual surgical tool, which is an example and is not limited by a specific shape.

[0092] The above virtual medical tool control device (20) may include an incision signal generation unit that outputs an incision signal to the incision simulation modeling device (10). The incision signal generation unit may correspond to a button or a touch sensor of a predetermined shape, which is an example and is not limited by a specific device.

[0093] When the virtual medical tool (300) comes into contact with the first layer (210), the user can generate an incision signal using the incision signal generation unit. The incision signal may correspond to a signal that instructs the feedback control unit (130) to remove the mesh in the area where the virtual medical tool (300) comes into contact with the first layer (210).

[0094] The virtual medical tool control device (20) may include a haptic providing unit that provides a haptic response to a user by a signal output from the feedback control unit (130). The signal output from the feedback control unit (130) may correspond to a signal corresponding to the movement resistance force and / or vertical repulsion force. The virtual medical tool control device (20) may relatively further increase the user's sense of simulation immersion by providing the user with a haptic response to the movement resistance force and / or vertical repulsion force.

[0095] FIG. 9 is a block diagram of a cutting simulation system according to another embodiment of the present specification.

[0096] Referring to FIG. 9, an incision simulation system (1') according to another embodiment of the present specification may include an incision simulation modeling device (10), a virtual medical tool control device (20), and a display device (30).

[0097] The display device (30) can display the virtual space provided by the virtual space providing unit (110), the virtual object (200), and the virtual medical tool (300). The display device (30) can be a display of a predetermined form mounted on the user's head. For example, the display device can correspond to smart glasses, smart goggles, a head mounted display, or a helmet mounted display of a VR (virtual reality) device and / or an AR (augmented reality) device. This is just one example, and the display device can be various, such as a CRT (Cathode-Ray Tube), a PDP (Plasma Display Panel), an LCD (Liquid Crystal Display), an LED (Light Emitting Diode), or an OLED (Organic Light Emitting Diode), and is not limited by a specific display device.

[0098] The above memory unit (100), virtual space providing unit (110), virtual medical tool control unit (120), and feedback control unit (130) may include a processor, application-specific integrated circuit (ASIC), other chipset, logic circuit, register, communication modem, data processing device, etc. known in the technical field to which the present invention pertains in order to execute calculations and various control logics. In addition, when the above-described control logic is implemented in software, the memory unit (100), virtual space providing unit (110), virtual medical tool control unit (120), and feedback control unit (130) may be implemented as a set of program modules. At this time, the program modules may be stored in the memory device and executed by the processor.

[0099] This specification assumes a simulation situation of a myringotomy. This is merely an example, and the modeling data for virtual objects and virtual medical tools may vary depending on the simulation of various incision procedures, such as pericardiotomy and / or durotomy, and the feedback generated may also vary. Therefore, the simulation is not limited to the above-mentioned myringotomy, and various embodiments may arise depending on the type of incision simulation.

[0100] While the embodiments of this specification have been described with reference to the attached drawings, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without altering the technical spirit or essential features thereof. Therefore, the embodiments described above should be understood to be illustrative in all respects and not restrictive.

[0101] [Explanation of symbols]

[0102] 1: Incision simulation system

[0103] 10: Incision simulation modeling device

[0104] 20: Virtual Medical Tool Control Device

[0105] 30: Display device

[0106] 100: Memory section

[0107] 110: Virtual Space Provider

[0108] 120: Virtual Medical Tool Control Unit

[0109] 130: Feedback control unit

Claims

1. A memory section storing modeling data for a virtual object with 3 layers and modeling data for a virtual medical tool; A virtual space providing unit providing a virtual space in which the above virtual objects and virtual medical tools are placed; A virtual medical tool control unit that controls the movement of the virtual medical tool within the virtual space according to an external input signal; and An incision simulation modeling device, comprising: a feedback control unit that generates feedback for the virtual object or the virtual medical tool when the virtual object and the virtual medical tool come into contact within the virtual space.

2. In claim 1, The three layers of the above virtual object are: The first layer forming the incision target; a second layer forming a non-incision target; and An incision simulation modeling device, comprising a third layer for generating vertical repulsive force of the virtual medical tool.

3. In claim 2, The second layer is positioned between the first layer and the third layer, A cutting simulation modeling device, characterized in that the second layer is formed as a blank area in an area corresponding to the first layer.

4. In claim 2, The above first layer has a mesh shape formed by cloud points, The above feedback control unit is an incision simulation modeling device that destroys the mesh of an area of ​​the first layer that is in contact with the virtual medical tool.

5. In claim 4, The above feedback control unit, An incision simulation modeling device that moves the position of a cloud point adjacent to a mesh that has been destroyed by contact with the virtual medical tool in the area of ​​the first layer by a preset amount in the direction in which the virtual medical tool has moved.

6. In claim 4, The above feedback control unit, An incision simulation system that generates a feedback signal regarding the resistance to movement of the virtual medical tool when the virtual medical tool comes into contact with the first layer.

7. In claim 4, The above feedback control unit, An incision simulation modeling device that generates feedback by modeling the outflow of body fluid when the above mesh object is destroyed.

8. In claim 8, The above feedback control unit, An incision simulation modeling device that generates a feedback signal that restricts the entry of the virtual medical tool when the virtual medical tool comes into contact with the third layer.

9. A cutting simulation modeling device according to any one of claims 1 to 8; and An incision simulation system, comprising: a virtual medical tool control device for outputting a movement signal of the virtual medical tool to a virtual medical tool control unit of the incision simulation modeling device.

10. In claim 9, The above virtual medical tool control device, An incision simulation system, comprising: an incision signal generating unit for outputting an incision signal to the above-mentioned incision simulation modeling device.

11. In claim 9, The above virtual medical tool control device, An incision simulation system, comprising a haptic providing unit that provides a haptic response to a user by a signal output from a feedback control unit of the incision simulation modeling device.

12. In claim 9, An incision simulation system further comprising a display device for displaying a virtual space provided by a virtual space providing unit of the incision simulation modeling device, the virtual object, and a virtual medical tool.

13. In claim 12, The above display device, An incision simulation system characterized by a display of a predetermined form mounted on a user's head.

Citation Information

Patent Citations

  • Method for Providing Training of Image Guided Surgery and Computer-readable Recording Medium for the same

    KR1020150113929A

  • Air bag cushion for a vehicle

    KR102780780B1

  • System and method for providing assistance in surgery in presence of tissue deformation

    US20170243344A1

  • Virtual reality surgical training systems

    US20220151700A1

  • Cutting simulation device and cutting simulation program

    WO2013014868A1