Method, apparatus, and program for providing patient-customized 3D surgical simulation

Abstract

A method for providing a patient-customized 3D surgical simulation method according to the present invention may include: obtaining a scan image including an image of a target object output by scanning a patient's body; identifying, on the scan image, each image of the target object and one or more organs and blood vessels adjacent to the target object; generating a first 3D model for a surgical area based on first 3D modeling data for the identified image and separate second 3D modeling data related to the one or more organs and blood vessels; setting third 3D modeling data and environmental variables for a surgical device applied to the first 3D model; generating a second 3D model for the surgical device based on the third 3D modeling data and the environmental variables; and providing the patient-customized surgical simulation based on the first 3D model and the second 3D model.

Description

Technical Field

[0001] The present disclosure relates to a method, an apparatus, and a program for providing a simulation. More specifically, the present disclosure relates to a method, an apparatus, and a program for providing a patient-customized 3D surgical simulation.

Background Art

[0002] In recent years, when performing a surgery in a hospital, in order to check the patient's condition and the surgical execution conditions before the surgery and increase the success probability of the surgery, a 3D simulation (stereoscopic image) of the patient's surgical site is generated, and a virtual surgery is performed under the same conditions as the actual surgery.

[0003] In such a virtual simulation surgery, a precise diagnosis can be made on the patient's body and a surgical plan can be made in advance. As a result, instead of relying on the intuition of a specialist, by performing a virtual simulation surgery, even extremely small errors related to the surgery can be reduced.

[0004] However, such a virtual simulation surgery has the problem of lacking a sense of reality. In addition, in the case of a surgical operation, there is a problem that the medical staff cannot perform a virtual simulation surgery under the same conditions as the actual surgery.

Summary of the Invention

Problems to be Solved by the Invention

[0005] The present disclosure has been made in view of the above circumstances, and an object thereof is to provide a method, an apparatus, and a program for providing a patient-customized 3D surgical simulation.

[0006] The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by a person skilled in the art from the following description.

Means for Solving the Problems

[0007] A method for providing a patient-customized 3D surgical simulation according to an embodiment of the present disclosure for solving the above-described problems includes: obtaining a scan image including an image of a target object output by scanning a patient's body; identifying, on the scan image, an image of the target object and images of one or more organs and blood vessels adjacent to the target object; generating a first 3D model for a surgical area based on first 3D modeling data for the identified image and separate second 3D modeling data related to the one or more organs and blood vessels; setting third 3D modeling data and environmental variables for a surgical device applied to the first 3D model; generating a second 3D model for the surgical device based on the third 3D modeling data and the environmental variables; and providing the patient-customized surgical simulation based on the first 3D model and the second 3D model.

[0008] Further, the scan image includes a computed tomography (CT) image of the patient's body, and the identifying step may include detecting and setting boundaries of respective images of a plurality of objects included in the CT image, dividing the images of the plurality of objects along the set boundaries, and identifying an image of the target object and images of organs and blood vessels adjacent to the target object among the divided images of the plurality of objects.

[0009] Furthermore, the second 3D modeling data may include at least one of data 3D-modeled in advance for each of the one or more organs and blood vessels or data 3D-modeled for each of the one or more organs and blood vessels obtained through an artificial intelligence (AI) model.

[0010] In addition, the step of generating the first 3D model may include comparing the fourth 3D modeling data for the one or more organs and blood vessels included in the first 3D modeling data with the second 3D modeling data, and combining the fourth 3D modeling data and the second 3D modeling data based on the comparison result.

[0011] The comparison result includes 3D modeling data for specific parts of the one or more organs and blood vessels that are included in the second 3D modeling data and not included in the CT image, and the step of generating the first 3D model may include combining the 3D modeling data for the specific parts with the fourth 3D modeling data.

[0012] The combining step may include applying at least one of a smoothing filter or a blending filter to a boundary portion between the 3D modeling data for the specific parts and the fourth 3D modeling data.

[0013] The step of generating the first 3D model includes uploading fifth 3D modeling data for body tissues within a preset distance from the target object, and generating the first 3D model based on the first 3D modeling data, the second 3D modeling data, or the fifth 3D modeling data. The fifth 3D modeling data may include template data for which a rigging operation has been performed so that other 3D modeling data can be combined.

[0014] The environmental variables may include at least one of pivot-related setting information for the movement of the surgical device or setting information regarding the effects that the surgical device can apply to the first 3D model.

[0015] As yet another example of the present disclosure, an apparatus for providing a patient-customized 3D surgical simulation includes one or more communication modules, one or more memories, and one or more processors. The one or more processors scan a patient's body to obtain a scan image including an image of a target object, identify on the scan image an image of each of the target object and one or more organs and blood vessels adjacent to the target object, generate a first 3D model for a surgical part based on at least one of first 3D modeling data for the identified image or second 3D modeling data related to the one or more organs and blood vessels, set third 3D modeling data and environmental variables for a surgical device applied to the first 3D model, generate a second 3D model for the surgical device based on the third 3D modeling data and the environmental variables, and can be set to provide the patient-customized 3D surgical simulation based on the first 3D model and the second 3D model.

[0016] In addition, a computer program stored in a computer-readable recording medium for executing the present disclosure can be further provided.

[0017] In addition, a computer-readable recording medium for recording a computer program for executing a method for implementing the present disclosure can be further provided. [[Effect of the Invention]]

[0018] According to the solution to the above-described problems of the present disclosure, a method, an apparatus, and a program for providing a patient-customized 3D surgical simulation can be provided.

[0019] Also, according to the solution to the above-described problems of the present disclosure, it is possible to confirm the human body structure of an actual patient on a 3D simulation, which can be useful for an actual surgery.

[0020] The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those of ordinary skill in the art from the following description.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0022] Throughout the present disclosure, the same reference numerals denote the same components. The present disclosure does not explain all elements of the embodiments, and general contents in the technical field to which the present disclosure pertains or overlapping contents in the embodiments are omitted. The terms "section, module, member, block" used in the specification can be embodied in software or hardware, and a plurality of "sections, modules, members, blocks" can be embodied as one component according to an embodiment, or one "section, module, member, block" can also include a plurality of components.

[0023] Throughout the specification, when a certain part is said to be "connected" to another part, this includes not only the case of being directly connected but also the case of being indirectly connected, and the indirect connection includes being connected via a wireless communication network.

[0024] Also, when a certain part "includes" a certain component, unless otherwise stated to the contrary, this does not exclude other components, but means that other components can be further included.

[0025] Throughout the specification, when a certain member is said to be "above" another member, this includes not only the case where a certain member is in contact with another member, but also the case where another member exists between the two members.

[0026] Terms such as first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.

[0027] Singular expressions include plural expressions unless there is a clear exception in the context.

[0028] At each stage, the identification codes are used for convenience of explanation, and the identification codes do not explain the order of each stage. Unless a specific order is clearly described in the context, each stage can be implemented in an order different from the described order.

[0029] Unless otherwise defined, all terms used in this specification (including technical and scientific terms) are used as meanings commonly understood by ordinary technicians in the technical field to which the present invention pertains. Also, terms defined in commonly used dictionaries are not ideally or overly interpreted unless specifically defined otherwise.

[0030] Hereinafter, the operating principle and embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0031] When explaining the present disclosure, "video" may mean multi-dimensional data composed of discrete video elements (for example, pixels in 2D video and voxels in 3D video). For example, the video can include medical videos of an object obtained by a CT imaging device, etc.

[0032] When describing the present disclosure, an "object" can be a person (e.g., a patient) or an animal, or a part or all of a person or an animal. For example, the object can include at least one of organs such as the liver, heart, uterus, brain, breast, abdomen, etc., and blood vessels (e.g., artery or vein, etc.), adipose tissue, etc. And a "target object" can mean a part of a person who is the subject of an actual operation.

[0033] When describing the present disclosure, a "user" can be a doctor, a nurse, a clinical pathologist, a medical imaging expert, etc. as a medical professional, and can be a technician who repairs medical devices, but is not limited thereto.

[0034] When describing the present disclosure, "3D modeling data" means data that visualizes a specific object in 3D, and a "3D model" can mean an element of a simulation generated through the combination of one or more 3D modeling data.

[0035] "3D modeling data" or / and "3D model" are provided in 2D on a display provided to the user, but can be provided so as to appear in a 3D form, or so that a body part appears in the actual space through the corresponding display like augmented reality.

[0036] When describing the present disclosure, an "apparatus" (i.e., an apparatus for performing a patient-customized 3D surgical simulation method) includes all various apparatuses that can perform arithmetic processing and provide results to the user.

[0037] For example, the device may include not only a desktop PC and a notebook PC, but also a smart phone, a tablet PC, a cellular phone, a PCS phone (Personal Communication Service phone), a synchronous / asynchronous IMT-2000 (International Mobile Telecommunication-2000) mobile terminal, a palm PC (Palm Personal Computer), a personal digital assistant (PDA), and the like. Also, when a head mounted display (HMD) device includes a computing function, the HMD device can be the device. Further, the device can be implemented in a separate server that receives requests from clients and performs information processing.

[0038] FIG. 1 is a schematic diagram of a system 1000 for implementing a method for providing a patient-customized 3D surgical simulation according to an embodiment of the present disclosure.

[0039] As shown in FIG. 1, a system 1000 for implementing a method for providing a patient-customized 3D surgical simulation may include a device 100, a hospital server 200, a database 300, and an AI model 400.

[0040] Here, FIG. 1 shows an embodiment in which the device 100 is embodied in the form of a single desktop, but is not limited thereto. As described above, the device 100 may mean various types of devices or a group of devices to which one or more types of devices are connected.

[0041] The device 100, hospital server 200, database 300, and artificial intelligence (AI) model 400 included in the system 1000 can communicate via the network W. Here, the network W can include a wired network and a wireless network. For example, the network can include various networks such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN).

[0042] Also, the network W can include the well-known World Wide Web (WWW). However, the network W according to the embodiments of the present disclosure is not limited to the networks listed above, and can also include at least a part of a known wireless data network, a known telephone network, and a known wired / wireless television network.

[0043] The device 100 can provide a patient-customized 3D surgical simulation method. For example, the device 100 can generate a 3D model for the surgical area based on a scan image including an image of a target object output by scanning the patient's body. The device 100 can generate a second 3D model related to the surgical device applied to the first 3D model. The device 100 can provide a patient-customized surgical simulation based on the first 3D model and the second 3D model. The operations related thereto will be specifically described with reference to the drawings described later.

[0044] The hospital server 200 (for example, a cloud server, etc.) can store a scan image (for example, a computer tomography (CT) image) obtained by scanning the patient's body. The hospital server 200 can transmit the stored scan image to the device 100, the database 300, or the AI model 400.

[0045] The hospital server 200 can protect personal information of the body by anonymizing or pseudonymizing the subject of the CT image. In addition, the hospital server can encrypt and store information related to the age / gender / height / weight / presence or absence of childbirth of the patient who is the subject of the CT image input by the user.

[0046] The database 300 can store various object / 3D modeling data and 3D models for the surgical device generated by the device 100. As another example, the database 300 can store template data on which a rigging operation has been performed so as to be combined with various 3D modeling data. In FIG. 1, the case where the database 300 is implemented outside the device 100 is shown, but the database 300 can also be implemented as a component of the device 100.

[0047] The AI model 400 is an artificial intelligence model trained to output 3D modeling data for a specific object. The AI model 400 can be trained to output 3D modeling data for a specific object through a dataset constructed from actual surgical videos or CT images and anatomical related materials. The learning method can include, but is not limited to, supervised training / unsupervised training, etc. The 3D modeling data for a plurality of objects output through the AI model 400 can be stored in the database 300 or / and the memory of the device 100.

[0048] FIG. 1 shows the case where the AI model 400 is implemented outside the device 100 (for example, implemented on a cloud-based platform), but is not limited thereto, and can be implemented as one component of the device 100.

[0049] FIG. 2 is a block diagram for explaining the configuration of a device 100 that provides a patient-customized 3D surgical simulation according to an embodiment of the present disclosure.

[0050] As shown in FIG. 2, the apparatus 100 can include a memory 110, a communication module 120, a display 130, an input module 140, and a processor 150. However, it is not limited thereto, and the software and hardware configurations of the apparatus 100 can be modified / added / omitted within a range that is obvious from the perspective of those skilled in the art according to the necessary operations.

[0051] The memory 110 can store data that supports various functions of the present apparatus 100, a program for the operation of the processor 150, input / output data (e.g., music files, still images, videos, etc.), and can store a number of application programs (application program or application) driven by the present apparatus, data for the operation of the apparatus 100, and instruction words. At least a part of such application programs can be downloaded from an external server via wireless communication.

[0052] Such a memory 110 can include at least one type of storage medium among flash memory type, hard disk type, SSD type (Solid State Disk type), SDD type (Silicon Disk Drive type), multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

[0053] In addition, the memory 110 can include a database that is separated from the present device but connected by wire or wirelessly. That is, the database shown in FIG. 1 can be embodied as a component of the memory 110.

[0054] The communication module 120 can include one or more components that enable communication with an external device. For example, it can include at least one of a broadcast reception module, a wired communication module, a wireless communication module, a short-range communication module, and a position information module.

[0055] The wired communication module can include not only various wired communication modules such as a local area network (LAN) module, a wide area network (WAN) module, or a value added network (VAN) module, but also various cable communication modules such as USB (Universal Serial Bus), HDMI (registered trademark) (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-232 (recommended standard 232), power line communication, or POTS (plain old telephone service).

[0056] In addition to Wi-Fi and Wireless broadband modules, the wireless communication module can include wireless communication modules that support various wireless communication methods such as GSM (Global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (registered trademark) (Wideband Code Division Multiple Access), UMTS (Universal Mobile Telecommunications System), TDMA (Time Division Multiple Access), LTE (Long Term Evolution), 4G, 5G, 6G, etc.

[0057] The display 130 displays (outputs) the information processed by the device 100 (for example, 3D modeling data / models or simulation screens based on 3D modeling data / models). For example, the display can display the execution screen information of an application program (as an example, an application) driven by the device 100, or UI (User Interface) and GUI (Graphic User Interface) information based on such execution screen information.

[0058] The input module 140 is for receiving input of information from the user. When information is input via the user input unit, the processor 150 can control the operation of the device 100 to correspond to the input information.

[0059] Such an input module 140 can include a hardware-based physical key (e.g., a button, dome switch, jog wheel, jog switch, etc. located on at least one of the front, rear, and sides of the device), and software-based touch keys. As an example, the touch keys can consist of virtual keys, soft keys, or visual keys displayed on a touch screen type display 130 through software processing, or can consist of touch keys arranged on a part other than the touch screen. On the other hand, the virtual keys or visual keys can be displayed on the touch screen while having various forms, and can consist of, for example, graphics, text, icons, videos, or combinations thereof.

[0060] The processor 150 can control the overall operation and functions of the device 100. Specifically, the processor 150 can be implemented with a memory that stores data for an algorithm or a program that reproduces the algorithm for controlling the operation of components within the device 100, and at least one processor (not shown) that performs the above-described operations using the data stored in the memory. At this time, the memory and the processor can be implemented on separate chips. Or, the memory and the processor can also be implemented on a single chip.

[0061] Also, the processor 150 can control by combining any one or more of the above-described components in order to implement various embodiments according to the present disclosure described in FIGS. 3 to 5 on the device 100.

[0062] FIG. 3 is a flowchart for explaining a method of providing a patient-customized 3D surgical simulation through a device according to an embodiment of the present disclosure.

[0063] The device can obtain a scan image containing an image of the target object by scanning the patient's body (S310).

[0064] For example, the device can receive a CT image obtained by scanning the patient's body from a hospital server. Specifically, the device can transmit a signal requesting a CT image of a specific patient containing an image of the target object to the hospital server (or a device controlled by the hospital). The hospital server can transmit a CT image of a specific patient containing an image of the target object to the device according to the request signal of the device.

[0065] However, this is only an example, and the device can receive a CT image containing an image of the target object from a CT imaging device connected to the device wirelessly / wiredly.

[0066] The device can identify each image of the target object and one or more organs and blood vessels adjacent to the target object on the scan image (S320).

[0067] Then, the device can generate a first 3D model for the surgical area (i.e., a certain area containing the target object) (S330). The explanations of S320 and S330 will be specifically described with reference to FIG. 4.

[0068] The device can set third 3D modeling data and environmental variables for the surgical device applied to the first 3D model (S340). That is, the device can set 3D modeling data and environmental variables for the surgical device for performing virtual simulation surgery on the 3D model related to each object in the simulation.

[0069] Here, the environmental variables can include at least one of pivot-related setting information for the movement of the surgical device or setting information regarding the effect that the surgical device can be applied to the first 3D model.

[0070] For example, if a specific surgical device is a scalpel, the environmental variables of the scalpel can include pivot-related setting information for the movement of the scalpel or setting information regarding the effects applicable to the target object (e.g., the effect of cutting and removing the target object).

[0071] The device can generate a second 3D model for the surgical device based on the third 3D modeling data and the environmental variables (S350).

[0072] Then, the device can provide a patient-customized surgical simulation based on the first 3D model and the second 3D model (S360).

[0073] That is, the device can generate / provide a (patient-customized surgical) simulation for virtual simulated surgery to the user using the first 3D model based on the 3D modeling data for each of the target object and the devices / vessels adjacent to or located in the periphery of the target object and the second 3D model for the surgical device.

[0074] FIG. 4 is a flowchart for explaining a method of generating a first 3D model for a surgical area according to an embodiment of the present disclosure. That is, FIG. 4 is a specific exemplification of S320 to S330 described with reference to FIG. 3.

[0075] The device can detect and set the boundaries of the images of the plurality of objects included in the CT image (S410). Then, the device can divide the images of the plurality of objects along the set boundaries (S420). That is, the device can automatically detect and set the boundaries of each object in order to classify / divide the objects included in the CT image.

[0076] Then, the device can identify the image for the target object and the images for the organs and blood vessels adjacent to the target object among the images of the plurality of divided objects (S430).

[0077] For example, assume that the target object is the gallbladder (i.e., assume that the surgery performed on the patient is a cholecystectomy). The CT image acquired by the device can include images of the gallbladder and the blood vessels / organs / fat tissues adjacent to the gallbladder. The device can detect and set the respective boundaries of the images of the gallbladder and the blood vessels / organs / fat tissues adjacent to the gallbladder. Then, the device can segment the images of the gallbladder and the blood vessels / organs / fat tissues adjacent to the gallbladder along the detected and set boundaries. And the device can identify the image of the target object and the images of the gallbladder and the blood vessels / organs / fat tissues adjacent to the gallbladder on the segmented images.

[0078] In the device, the automatically segmented / detected / identified target object and the images of the organs / vessels adjacent to the target object can be inspected by other users. The device can correct the segmented / detected / identified images based on the inspection results of the users.

[0079] The device can compare the fourth 3D modeling data for one or more organs and blood vessels included in the first 3D modeling data with the second 3D modeling data (S440). Then, the device can combine the fourth 3D modeling data and the second 3D modeling data based on the comparison result (S450).

[0080] Here, the second 3D modeling data can include at least one of the data obtained by pre-modeling in 3D for each of one or more organs and blood vessels or the data obtained by modeling in 3D for each of one or more organs and blood vessels through an AI model.

[0081] And the comparison result can include the 3D modeling data for specific parts of one or more organs and blood vessels included in the second 3D modeling data and not included in the CT image. That is, the specific parts can mean the parts not included in the CT image among the images of the organs / vessels adjacent to the target object.

[0082] The device can combine 3D modeling data for a specific part with fourth 3D modeling data. That is, the device can generate modeling data for organs / vessels that are completely adjacent to the target object by combining the modeling data for the specific part that is not included in the CT image with the fourth 3D modeling data.

[0083] When combining the modeling data for the specific part with the fourth 3D modeling data, at least one of a smoothing filter or a blending filter can be used. For example, the device can apply at least one of a smoothing filter or a blending filter to the boundary part between the 3D modeling data for the specific part and the fourth 3D modeling data. Thereby, the boundary part between the 3D modeling data for the specific part and the fourth 3D modeling data can be expressed seamlessly.

[0084] The device can additionally combine fifth 3D modeling data for body tissues within a preset distance from the target object (S460).

[0085] Specifically, the device can upload fifth 3D modeling data for body tissues within a preset distance from the target object from a separate database. The fifth 3D modeling data can mean template data for which a rigging operation has been performed so that it can be combined with other 3D modeling data.

[0086] Here, the body tissues within a preset distance from the target object can mean objects located in the peripheral region of the target object. For example, when the target object is the gallbladder, the body tissues within a preset distance can include the omentum formed from the intestine above the gallbladder and the like.

[0087] 3D modeling data for the omentum can be produced in a form that drapes from the stomach to cover the intestines. At this time, the upper part of the 3D modeling data for the omentum can be adjusted to move in a templated operation through rigging work so that the draping part can be connected to the 3D modeling data for the target object generated based on the CT image. As a result, the draping part can be changed so as to correspond to different stomach morphologies, and more natural 3D modeling data for the omentum can be realized.

[0088] The device can generate a first 3D model based on the first 3D modeling data, the second 3D modeling data, and the fifth 3D modeling data.

[0089] FIG. 5 is a drawing for explaining a patient-customized 3D surgical simulation according to an embodiment of the present disclosure.

[0090] FIG. 5 shows a screen of the simulation generated by the device. The device can generate a first 3D model 510 based on 3D modeling data for the target object and the blood vessels / organs adjacent to the target object. Through the corresponding simulation screen, the user can confirm in advance the structure of the blood vessels and the morphology of the organs before performing the surgery.

[0091] Then, the device can embody second 3D models 520, 530 for the surgical device applicable to the first 3D model 510 on the simulation. The user can perform a simulated virtual surgery by applying the second models 520, 530 to the first 3D model 510.

[0092] On the other hand, the disclosed embodiment can be embodied in the form of a recording medium storing computer-executable instructions. The instructions can be stored in the form of program code and, when executed by a processor, can generate program modules to perform the operations of the disclosed embodiment. The recording medium can be embodied as a computer-readable recording medium.

[0093] Examples of computer-readable recording media include all types of recording media storing instruction codes that can be decoded by a computer. For example, there may be ROM (Read Only Memory), RAM (Random Access Memory), magnetic tape, magnetic disk, flash memory, optical data storage devices, and the like.

[0094] As described above, the embodiments disclosed with reference to the accompanying drawings have been explained. Those having ordinary knowledge in the technical field to which the present disclosure pertains can understand that the present disclosure can be implemented in forms different from the disclosed embodiments without changing the technical idea and essential features of the present disclosure. The disclosed embodiments are exemplary and should not be construed in a limiting sense.

Claims

1. A method for providing a patient-customized 3D surgical simulation method performed by a device, comprising: obtaining a scan image including an image of a target object output by scanning a patient's body; identifying, on the scan image, each image of the target object and one or more organs and blood vessels adjacent to the target object; generating a first 3D model of a surgical area based on first 3D modeling data for the identified images and separate second 3D modeling data related to the one or more organs and blood vessels; setting third 3D modeling data and environmental variables for a surgical device applied to the first 3D model; generating a second 3D model of the surgical device based on the third 3D modeling data and the environmental variables; providing the patient-customized 3D surgical simulation based on the first 3D model and the second 3D model; A method comprising the above steps.

2. The scan image includes a computed tomography (CT) image of the patient's body, and the identifying step includes: detecting and setting boundaries of each of the images of a plurality of objects included in the CT image; segmenting the images of the plurality of objects along the set boundaries; identifying an image of the target object and images of organs and blood vessels adjacent to the target object among the segmented images of the plurality of objects; The method according to claim 1, characterized by including the above steps.

3. The second 3D modeling data is ​The method according to claim 2, characterized in that it includes at least one of the data obtained by 3D modeling in advance for each of the one or more organs and blood vessels, or the data obtained by 3D modeling for each of the one or more organs and blood vessels through an artificial intelligence (AI) model.

4. The step of generating the first 3D model includes: comparing the fourth 3D modeling data for the one or more organs and blood vessels included in the first 3D modeling data with the second 3D modeling data; combining the fourth 3D modeling data and the second 3D modeling data based on the comparison result; The method according to claim 3, characterized by including the above.

5. The comparison result includes: 3D modeling data for specific parts of the one or more organs and blood vessels included in the second 3D modeling data and not included in the CT image; The step of generating the first 3D model includes: The method according to claim 4, characterized by including the step of combining the 3D modeling data for the specific part and the fourth 3D modeling data.

6. The combining step includes: applying at least one of a smoothing filter or a blending filter to the boundary part of the 3D modeling data for the specific part and the fourth 3D modeling data. The method according to claim 5 is characterized by including the above.

7. The step of generating the first 3D model includes: uploading the fifth 3D modeling data for the body tissue within the preset distance from the target object; Generating the first 3D model based on the first 3D modeling data, the second 3D modeling data, or the fifth 3D modeling data; including; The method according to claim 6, wherein the fifth 3D modeling data is template data on which a rigging operation has been performed so that other 3D modeling data can be combined.

8. The environmental variable is; The method according to claim 7, characterized by including at least one of pivot-related setting information for the movement of the surgical device or setting information regarding an effect that the surgical device can apply to the first 3D model.

9. In an apparatus for providing a patient-customized 3D surgical simulation, one or more communication modules; one or more memories; one or more processors; including; The one or more processors; scan the patient's body to obtain a scan image including an image of a target object, identify each image of the target object and one or more organs and blood vessels adjacent to the target object on the scan image, generate a first 3D model for a surgical part based on at least one of the first 3D modeling data for the identified image or the second 3D modeling data related to the one or more organs and blood vessels, set third 3D modeling data and environmental variables for a surgical device applied to the first 3D model, generate a second 3D model for the surgical device based on the third 3D modeling data and the environmental variables, An apparatus configured to provide the patient-customized 3D surgical simulation based on the first 3D model and the second 3D model. **Claim 10** A computer program stored in a computer-readable recording medium, which is coupled to an apparatus that is hardware and causes the apparatus to execute a method for providing the patient-customized 3D surgical simulation according to any one of claims 1 to 8.

Images