Ai-based method and apparatus for providing environment for virtual reality surgery modeling

Abstract

The present invention relates to an AI-based method and apparatus for providing an environment for virtual reality surgery modeling, the method performed by a virtual reality providing apparatus and comprising the steps of: loading data from a patient terminal; pre-processing the loaded data; performing 3D modeling by integrating the pre-processed data; loading data from an Internet of things terminal; and providing a VR simulation environment related to patient surgery on the basis of the loaded data and a 3D modeling result.

Description

Method and apparatus for providing an AI-based virtual reality surgical modeling environment

[0001] The present invention relates to a method and apparatus for providing an AI-based virtual reality surgical modeling environment, and more specifically, to a method and apparatus for providing a realistic surgical modeling environment related to various images, including CT scans, MRI, angiography, and endoscopy, by utilizing generative AI technology tailored to the anatomical and pathological characteristics of each patient.

[0002] Virtual reality is revolutionizing medical practice by providing powerful ways to explore and interact with digital medical data. Potential benefits of adding VR to surgical training include preoperative residents being exposed to surgical techniques and practicing complex procedures in a risk-free environment, improving patient safety outcomes, and reducing potential errors and complications during live surgery, which can also lead to reduced medical costs associated with surgical errors.

[0003] However, despite its potential benefits, VR technology is not without its limitations, and one of the major challenges is that current VR simulations may not be able to fully replicate the complexity of organic tissues or accurately simulate medical and surgical scenarios. These limitations can result in unrealistic virtual environments where physicians may not be adequately prepared for actual surgery. Standard 3D models used in VR simulations are often generated from imaging data such as CT scans and MRIs, but these models can be generic and may fail to capture the detailed complexity of individual patient cases. Consequently, these models may not effectively represent each patient's unique anatomical and pathological features, which can impact surgical planning and execution.

[0004] Manually creating detailed and accurate 3D models for surgical simulation is a complex and resource-intensive process, and integrating data from multiple image sources into a single, consistent 3D model requires a high level of expertise. This process is costly because it is not only labor-intensive but also requires significant time and effort from skilled professionals, and the manual approach to model creation also raises scalability issues. Since a new model is required for each new case, the efficiency of generating customized simulations for numerous unique patients is limited. These gaps may limit the widespread adoption of VR simulation in surgical training and practice and restrict its use in various medical centers worldwide. This highlights the urgent need for detailed, individualized, and affordable 3D models to enhance surgical simulation, and advancements in generative AI offer potential solutions to address these challenges. Creating highly accurate 3D models of the human body or specific body parts for surgical simulation requires integrating various detailed image modalities, each providing unique and critical information.

[0005] The aforementioned background technology is technical information that the inventor possessed for the derivation of the present invention or acquired during the process of deriving the present invention, and it cannot be considered technology that was known to the general public prior to the filing of the present invention.

[0006] The problem to be solved through the disclosure of the present invention is to address the issue that manually creating detailed and accurate 3D models for surgical simulation is a complex and resource-intensive process, which is not only labor-intensive but also costly because it requires significant time and effort from skilled professionals.

[0007] In addition, the problem to be solved through the disclosure of the present invention is to solve the problem that, in order to create a highly accurate 3D model of the human body or a specific part for surgical simulation, various detailed image modalities, each providing unique and important information, must be integrated.

[0008] The problem to be solved through the disclosure of the present invention is to provide an AI-based virtual reality surgery modeling environment, comprising the steps of: loading data from a patient terminal; preprocessing the loaded data; integrating the preprocessed data to perform 3D modeling; loading data from an Internet of Things terminal; and providing a VR simulation environment related to patient surgery based on the loaded data and the 3D modeling results.

[0009] In one embodiment, the step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results may further include the step of providing a smart surgical instrument to the VR simulation environment.

[0010] In one embodiment, the step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results may further include the step of receiving data collected from a smart surgical instrument and a corresponding surgical instrument.

[0011] In one embodiment, the step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results may further include the step of providing feedback data to the VR simulation environment based on received data.

[0012] In one embodiment, the step of providing feedback data to a VR simulation environment may further include the step of evaluating surgical movements based on the feedback data.

[0013] In one embodiment, the step of providing feedback data to a VR simulation environment may further include the step of providing evaluation results.

[0014] In one embodiment, the step of providing feedback data to a VR simulation environment may further include the step of providing the deviation or error from a predefined rule along with the evaluation result.

[0015] According to the means for solving the problem of the present invention described above, manually creating a detailed and accurate 3D model for surgical simulation is a complex and resource-intensive process, and can solve the problem of high costs as it is labor-intensive and requires significant time and effort from skilled professionals.

[0016] In addition, according to the means for solving the problem of the present invention described above, in order to create a very accurate 3D model of the human body or a specific part for surgical simulation, it is necessary to integrate various detailed image modalities that each provide unique and important information, and this problem can be solved.

[0017] FIG. 1 illustrates an exemplary environment in which a virtual reality providing device according to some embodiments of the present disclosure may be applied.

[0018] FIG. 2 is a flowchart relating to an operation of providing a surgical simulation based on a 3D modeling result that can be performed in a virtual reality providing device according to some embodiments of the present disclosure.

[0019] FIG. 3 is a flowchart for specifically describing the steps of providing a surgical simulation environment according to some embodiments of the present disclosure.

[0020] FIG. 4 is a flowchart for specifically describing the step of providing feedback data to a VR simulation environment according to some embodiments of the present disclosure.

[0021] FIG. 5 is an exemplary drawing of an architecture in which the present invention can be implemented according to some embodiments of the present disclosure.

[0022] FIG. 6 is a drawing of an exemplary computing device capable of implementing a device and / or system according to various embodiments of the present disclosure.

[0023] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the attached drawings. The advantages and features of the present disclosure and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the attached drawings. However, the technical concept of the present disclosure is not limited to the following embodiments but can be implemented in various different forms. The following embodiments are provided merely to complete the technical concept of the present disclosure and to fully inform those skilled in the art of the scope of the present disclosure, and the technical concept of the present disclosure is defined only by the scope of the claims.

[0024] It should be noted that when assigning reference numerals to the components of each drawing, the same components are given the same reference numeral whenever possible, even if they are shown in different drawings. Furthermore, in describing the present disclosure, if it is determined that a detailed description of related known components or functions could obscure the essence of the present disclosure, such detailed description is omitted.

[0025] Unless otherwise defined, all terms used herein (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which this disclosure pertains. Additionally, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise. The terms used herein are for describing the embodiments and are not intended to limit this disclosure. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text.

[0026] Additionally, terms such as first, second, A, B, (a), (b), etc., may be used to describe the components of the present disclosure. These terms are intended only to distinguish the components from other components and do not limit the nature, order, or sequence of the components. Where it is stated that a component is "connected," "coupled," or "joined" to another component, it should be understood that the component may be directly connected or joined to the other component, but that another component may also be "connected," "coupled," or "joined" between each component.

[0027] As used in the specification, "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components, steps, actions, and / or elements to the mentioned components, steps, actions, and / or elements.

[0028] Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the attached drawings.

[0029] In addition, terms such as first, second, A, B, (a), (b), etc. may be used when describing the components of the present invention. These terms are intended merely to distinguish the components from other components, and the essence, order, or sequence of the components is not limited by these terms. Throughout the specification, when a part is described as 'comprising' or 'equipped' with a certain component, unless specifically stated otherwise, this means that it may include additional components rather than excluding other components. Furthermore, terms such as 'part' or 'module' described in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software.

[0030]

[0031] FIG. 1 illustrates an exemplary environment in which a virtual reality providing device according to some embodiments of the present disclosure may be applied. Through a system comprising a patient data terminal (100), a virtual reality providing device (200), a physician terminal (300), and an Internet of Things terminal (400) as illustrated in FIG. 1, a highly detailed, individualized, and cost-effective model tailored to each patient's unique anatomical and pathological characteristics is provided, and by utilizing the latest advancements in scanning technology and generative AI, the system can perform the operation of integrating data from various imaging modalities, including CT scans, MRI, angiography, and endoscopy, to generate an accurate and comprehensive 3D model.

[0032] Below, the components illustrated in FIG. 1 related to the operation of providing a 3D model related to surgery simulation using a patient data terminal (100) and a virtual reality providing device (200) through the system described above will be explained in more detail.

[0033] FIG. 1 illustrates an example in which a patient data terminal (100), a virtual reality providing device (200), a doctor terminal (300), and an Internet of Things terminal (400) are connected via a network, but this is only for convenience of understanding, and the number of devices that can be connected to the network can vary.

[0034] Meanwhile, FIG. 1 merely illustrates a preferred embodiment for achieving the purpose of the present disclosure, and some components may be added or deleted as needed. Below, the components illustrated in FIG. 1 will be described in more detail.

[0035] The virtual reality providing device (200) can collect and analyze various information generated from the patient data terminal (100), the doctor terminal (300), and the Internet of Things terminal (400). The various information may include all data generated from the patient data terminal (100), the doctor terminal (300), and the Internet of Things terminal (400).

[0036] The patient data terminal (100) and doctor terminal (300) illustrated in FIG. 1 can be implemented through at least one electronic device and at least one computing device, and the patient data terminal (100) and doctor terminal (300) can be connected to the virtual reality providing device (200) of the present invention via a network to transmit and receive data to and from each other. Accordingly, the patient data terminal (100) and doctor terminal (300) can be a computing device, a mobile device, a desktop, a laptop, etc., and can be a high-performance server-class computing device.

[0037] The Internet of Things terminal (400) illustrated in FIG. 1 refers to an electronic device that performs technology for connecting to the Internet by embedding sensors and communication functions, and is a terminal related to technology for connecting various objects through wireless communication. Here, objects are various embedded systems such as home appliances, mobile equipment, and wearable devices. Objects connected to the Internet of Things must have a unique IP address that can distinguish them and must be connected to the Internet, and may embed sensors to acquire data from the external environment. In the present invention, the Internet of Things terminal (400) may refer to surgical instruments or surgical equipment used by a doctor during surgery in relation to medical practice. Accordingly, the Internet of Things terminal (400) has sensors and communication functions embedded and can transmit and receive data through a network with both the patient data terminal (100) and the doctor terminal (300).

[0038] Meanwhile, the virtual reality providing device (200) may also be implemented with one or more computing devices. For example, all functions of the virtual reality providing device (200) may be implemented in a single computing device. As another example, the first function of the virtual reality providing device (200) may be implemented in the first computing device, and the second function may be implemented in the second computing device. Here, the computing device may be a notebook, desktop, laptop, etc., but is not limited thereto and may include all types of devices equipped with computing functions. However, it may be preferable for the virtual reality providing device (200) to be implemented as a high-performance server-class computing device. An example of a computing device will be described with reference to FIG. 6.

[0039] Additionally, the functions that can be implemented in the virtual reality providing device (200) may also be implemented by utilizing electronic devices installed in the patient data terminal (100) or the doctor terminal (300). Therefore, although the virtual reality providing device (200) and the patient data terminal (100) or the doctor terminal (300) are depicted separately in FIG. 1, it is obvious that according to one embodiment, the virtual reality providing device (200) is installed in the patient data terminal (100) or the doctor terminal (300), and the virtual reality providing device can implement the first function, the second function, etc. within the patient data terminal (100) or the doctor terminal (300). Therefore, it should be noted that this interpretation is not limited to an embodiment in which the patient data terminal (100) or the doctor terminal (300) and the virtual reality providing device (200) are externally separated as shown in FIG. 1.

[0040] For convenience of explanation, the present specification describes a situation in which the patient data terminal (100) or doctor terminal (300) and the virtual reality providing device (200) are separated to implement functions.

[0041] In some embodiments, components included in an environment to which a virtual reality providing device (200) is applied may communicate through a network. The network may be implemented as any type of wired or wireless network, such as a Local Area Network (LAN), a Wide Area Network (WAN), a mobile radio communication network, or Wibro (Wireless Broadband Internet).

[0042] Meanwhile, the environment illustrated in FIG. 1 is shown as being connected via a network through a patient data terminal (100), a virtual reality providing device (200), a doctor terminal (300), and an Internet of Things terminal (400), but the scope of the present disclosure is not limited thereto, and it should be noted that the patient data terminal (100) may be connected via P2P (Peer to Peer) with the virtual reality providing device (200), the doctor terminal (300), and the Internet of Things terminal (400).

[0043] Up to now, with reference to FIG. 1, exemplary environments in which a virtual reality providing device (200) according to some embodiments of the present disclosure may be applied have been described. Hereinafter, with reference to FIG. 2 and the drawings, methods according to various embodiments of the present disclosure will be described in detail.

[0044] Each step of the methods described below may be performed by a computing device. In other words, each step of the methods may be implemented by one or more instructions executed by a processor of the computing device. All steps included in these methods may be performed by a single physical computing device, but the first steps of the methods may be performed by a first computing device and the second steps of the methods may be performed by a second computing device.

[0045] In FIG. 2 below, the explanation will continue assuming that each step of the methods is performed by the virtual reality providing device (200) exemplified in FIG. 1. However, for the convenience of explanation, the subject of the operation of each step included in the methods may be omitted.

[0046]

[0047] FIG. 2 is a flowchart relating to an operation of providing a surgical simulation based on a 3D modeling result that can be performed in a virtual reality providing device according to some embodiments of the present disclosure.

[0048] In step S100, the virtual reality providing device (200) can load data from the patient terminal (100). The virtual reality providing device (200) can load data regarding detailed external and internal views by collecting CT, MRI, angiography, and endoscopic data based on a selected area. That is, the virtual reality providing device (200) can load various types of image data related to the surgery of the patient corresponding to the patient terminal (100).

[0049] In step S200, the virtual reality providing device (200) can preprocess the loaded data. The virtual reality providing device (200) can preprocess the loaded data to create a comprehensive 3D model by processing and integrating various types of image data.

[0050] In step S300, the virtual reality provider (200) can perform 3D modeling by integrating preprocessed data. The virtual reality provider (200) includes an internally generative AI model and, based on the previously preprocessed data, can generate a clear representation of the 3D model in relation to the surgical simulation environment and supply the output to the VR environment. At this time, the 3D model may be a highly detailed, individualized, and cost-effective 3D model tailored to each patient's unique anatomical and pathological characteristics. The virtual reality provider (200) can utilize an explicit generative AI model that is ready to accurately reconstruct the 3D model from the processed data and integrate it into the VR environment.

[0051] In step S400, the virtual reality providing device (200) can load data from the Internet of Things terminal (400). At this time, the data loaded from the Internet of Things terminal (400) by the virtual reality providing device (200) refers to data generated from the Internet of Things terminal (400) through a sensor and communication function mounted on the Internet of Things terminal (400). In the present invention, the Internet of Things terminal (400) may refer to surgical instruments or surgical equipment used by a doctor during surgery in relation to medical procedures. Accordingly, the virtual reality providing device (200) can load data generated from the Internet of Things terminal (400).

[0052] In step S500, the virtual reality providing device (200) can provide a VR simulation environment related to patient surgery to the doctor terminal (300) based on loaded data and 3D modeling results. That is, the virtual reality providing device (200) can provide a VR simulation environment including virtual surgical instruments to the doctor terminal (300) in correspondence with the Internet of Things terminal (400). Accordingly, the doctor can receive a VR simulation environment related to surgery through the doctor terminal (300). More specific embodiments will be described in detail with reference to FIGS. 3 and 4.

[0053]

[0054] FIG. 3 is a flowchart for specifically describing the steps of providing a surgical simulation environment according to some embodiments of the present disclosure.

[0055] In step S510, the virtual reality providing device (200) can provide the smart surgical instrument to the VR simulation environment. In step S520, the virtual reality providing device (200) can receive data collected from the surgical instrument corresponding to the smart surgical instrument. That is, the virtual reality providing device (200) can collect data generated in relation to the smart surgical instrument, i.e., the virtual surgical instrument, performing surgery in the VR simulation while the doctor is performing surgery through the Internet of Things terminal (400). In step S530, the virtual reality providing device (200) can provide feedback data to the VR simulation environment based on the received data. That is, the virtual reality providing device (200) can continuously provide the surgical progress or surgical content regarding the process of the doctor performing surgery through the doctor terminal (300) and the Internet of Things terminal (400) via VR simulation. At this time, a specific example will be described in detail through FIG. 4.

[0056]

[0057] FIG. 4 is a flowchart for specifically describing the step of providing feedback data to a VR simulation environment according to some embodiments of the present disclosure.

[0058] In step S531, the virtual reality providing device (200) can evaluate surgical movements based on feedback data. That is, the virtual reality providing device (200) can perform a process of evaluating surgical movements to see if the doctor is performing the surgery well. That is, the surgical movement evaluation process can verify and evaluate whether the doctor is performing the surgery well in the VR simulation based on predefined rules and deviations or errors. In step S532, the virtual reality providing device (200) can provide evaluation results. In step S533, the virtual reality providing device (200) can provide information on deviations or errors from predefined rules along with the evaluation results. That is, the virtual reality providing device (200) can continuously provide the doctor with evaluations and results regarding the surgery through the doctor terminal (300) during the surgery.

[0059] Accordingly, the present invention provides a scoring system capable of applying predefined rules and evaluating surgical actions according to these rules, thereby warning physicians of potential errors or deviations from the optimal procedure, which can help minimize errors and improve overall surgical outcomes. Below, an exemplary environment in which the present invention can be implemented is described in detail using FIG. 5.

[0060]

[0061] FIG. 5 is an exemplary drawing of an architecture in which the present invention can be implemented according to some embodiments of the present disclosure.

[0062] Referring to FIG. 5, the virtual reality providing device (200) can collect patient data and provide a VR surgery simulation environment, which is a 3D modeling result, to a doctor through a doctor terminal (300). Furthermore, the doctor can perform surgery through a surgical instrument, which is one of the Internet of Things terminals (400), and continuously provide the surgical progress and feedback data.

[0063] Below, an exemplary computing device in which a virtual reality providing device (200) can be implemented will be described in detail through FIG. 6.

[0064]

[0065] FIG. 6 is a drawing of an exemplary computing device capable of implementing a device and / or system according to various embodiments of the present disclosure.

[0066] A computing device (1500) may include one or more processors (1510), a bus (1550), a communication interface (1570), a memory (1530) for loading a computer program (1591) executed by the processor (1510), and a storage (1590) for storing the computer program (1591). However, only components related to the embodiments of the present disclosure are illustrated in FIG. 6. Therefore, a person skilled in the art to which the present disclosure belongs will understand that other general-purpose components may be included in addition to the components illustrated in FIG. 6.

[0067] The processor (1510) controls the overall operation of each component of the computing device (1500). The processor (1510) may be configured to include a CPU (Central Processing Unit), an MPU (Micro Processor Unit), an MCU (Micro Controller Unit), a GPU (Graphic Processing Unit), or any form of processor well known in the art of the present disclosure. Additionally, the processor (1510) may perform operations for at least one application or program for executing the method according to the embodiments of the present disclosure. The computing device (1500) may have one or more processors.

[0068] The memory (1530) stores various data, commands and / or information. The memory (1530) may load one or more programs (1591) from storage (1590) to execute a method according to embodiments of the present disclosure. The memory (1530) may be implemented as volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

[0069] The bus (1550) provides communication functions between components of the computing device (1500). The bus (1550) can be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

[0070] The communication interface (1570) supports wired and wireless internet communication of the computing device (1500). Additionally, the communication interface (1570) may support various communication methods other than internet communication. To this end, the communication interface (1570) may be configured to include a communication module well known in the art of the present disclosure.

[0071] According to some embodiments, the communication interface (1570) may be omitted.

[0072] Storage (1590) can store one or more of the above programs (1591) and various data non-temporarily.

[0073] Storage (1590) may be configured to include non-volatile memory such as ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which this disclosure belongs.

[0074] A computer program (1591) may include one or more instructions that cause a processor (1510) to perform a method / operation according to various embodiments of the present disclosure when loaded into memory (1530). That is, the processor (1510) may perform a method / operation according to various embodiments of the present disclosure by executing the one or more instructions.

[0075] Various embodiments of the present disclosure and effects according to those embodiments have been described with reference to FIGS. 1 through 6. The effects according to the technical concept of the present disclosure are not limited to those described above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description in the specification.

[0076] The technical concept of the present disclosure described so far with reference to FIGS. 1 through 6 may be implemented as computer-readable code on a computer-readable medium. The computer-readable recording medium may be, for example, a removable recording medium (CD, DVD, Blu-ray disc, USB storage device, removable hard disk) or a fixed recording medium (ROM, RAM, computer-equipped hard disk). The computer program recorded on the computer-readable recording medium may be transmitted to another computing device via a network such as the Internet and installed on the other computing device, thereby being used on the other computing device.

[0077] In the foregoing, although all components constituting the embodiments of the present disclosure have been described as being combined or operating together, the technical concept of the present disclosure is not necessarily limited to such embodiments. That is, within the scope of the purpose of the present disclosure, all components may be selectively combined and operated in one or more ways.

[0078] Although operations are depicted in a specific order in the drawings, it should not be understood that the operations must be executed in the specific order depicted or in a sequential order, or that all depicted operations must be executed to obtain the desired result. In certain situations, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various configurations in the embodiments described above should not be understood as a necessary separation, and it should be understood that the described program components and systems can generally be integrated together into a single software product or packaged into multiple software products.

[0079] Although embodiments of the present disclosure have been described above with reference to the attached drawings, those skilled in the art will understand that the present disclosure may be practiced in other specific forms without changing the technical concept or essential features thereof. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. The scope of protection of the present disclosure shall be interpreted by the claims below, and all technical concepts within the equivalent scope shall be interpreted as being included within the scope of rights of the technical concept defined by the present disclosure.

Claims

1. A method performed by a virtual reality providing device, Step of loading data from a patient terminal; Step for preprocessing loaded data; A step of performing 3D modeling by integrating preprocessed data; Step of loading data from an Internet of Things terminal; and A step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results; The above VR simulation environment relates to a surgical environment performed by a physician and includes surgical instruments related to surgery. Method for providing an AI-based virtual reality surgical modeling environment.

2. In Paragraph 1, Based on loaded data and 3D modeling results, the step of providing a VR simulation environment related to patient surgery further includes the step of providing smart surgical instruments to the VR simulation environment. Method for providing an AI-based virtual reality surgical modeling environment.

3. In Paragraph 2, The step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes the step of receiving data collected from a smart surgical instrument and a corresponding surgical instrument. Method for providing an AI-based virtual reality surgical modeling environment.

4. In Paragraph 3, The step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes the step of providing feedback data to the VR simulation environment based on received data. Method for providing an AI-based virtual reality surgical modeling environment.

5. In Paragraph 4, The step of providing feedback data to a VR simulation environment further includes a step of evaluating surgical movements based on the feedback data. Method for providing an AI-based virtual reality surgical modeling environment.

6. In Paragraph 5, The step of providing feedback data to a VR simulation environment further includes the step of providing evaluation results. Method for providing an AI-based virtual reality surgical modeling environment.

7. In Paragraph 6, The step of providing feedback data to a VR simulation environment further includes a step of providing deviations or errors from predefined rules along with evaluation results. Method for providing an AI-based virtual reality surgical modeling environment.

8. Processor; Network interface; Memory; and It includes a computer program that is loaded into the memory and executed by the processor, The above processor is, Instructions to load data from a patient terminal; Instructions for preprocessing loaded data; Instructions for performing 3D modeling by integrating preprocessed data; Instructions for loading data from an Internet of Things terminal; and Instructions that provide a VR simulation environment related to patient surgery based on loaded data and 3D modeling results; are performed, including The above VR simulation environment relates to a surgical environment performed by a physician and includes surgical instruments related to surgery. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

9. In Paragraph 8, Based on loaded data and 3D modeling results, instructions for providing a VR simulation environment related to patient surgery are executed by further including instructions for providing smart surgical instruments to the VR simulation environment. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

10. In Paragraph 9, Based on loaded data and 3D modeling results, instructions for providing a VR simulation environment related to patient surgery further include instructions for receiving data collected from smart surgical instruments and corresponding surgical instruments. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

11. In Paragraph 10, An instruction that provides a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes an instruction that provides feedback data to the VR simulation environment based on the received data. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

12. In Paragraph 11, Instructions that provide feedback data to a VR simulation environment include additional instructions for evaluating surgical movements based on the feedback data. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

13. In Paragraph 12, Instructions that provide feedback data to a VR simulation environment are executed by further including instructions that provide evaluation results. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

14. In Paragraph 13, Instructions that provide feedback data to a VR simulation environment are executed by including additional instructions regarding deviations or errors from predefined rules, along with evaluation results. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

Images