Dental implant surgery step-by-step guide method, device and system using 3D CT and augmented reality

Abstract

According to one embodiment, in a method for guiding dental implant surgery steps using 3D CT and augmented reality, the implant surgery plan is established by analyzing the patient's oral 3D CT scan data according to pre-set surgical planning criteria, the implant placement location, drilling path, and surgical method are determined according to pre-set criteria based on the established surgical plan, the patient's oral structure is converted into a 3D virtual model based on the patient's oral 3D CT scan data, surgical guidelines are generated according to pre-set criteria based on the converted model, and the generated guidelines are output so that the surgeon can check them in real time through the surgeon's augmented reality (AR) terminal, the implant position and drilling angle are detected in real time during the implant placement process, the detected values ​​are compared with pre-set criteria, the surgeon's movements are detected through the surgeon's augmented reality terminal, and a warning is output to the augmented reality terminal by comparing the detected movements with pre-set criteria, and after the implant insertion is completed, the implant alignment status can be evaluated by analyzing the patient's oral 3D CT re-scan data.

Description

Technology Field

[0001] The following embodiments relate to a method, device, and system for guiding dental implant surgery steps using 3D CT and augmented reality. Background Technology

[0003] Dental implant surgery must be performed with precision, taking into account the patient's individual oral structure and bone density; to achieve this, thorough pre-operative planning and real-time guidance during the procedure are essential.

[0004] Conventional implant surgery methods establish surgical plans based on 2D X-ray images or 3D CT data, but there is a possibility that the actual procedure may deviate from the plan due to visual limitations. Furthermore, traditional methods require time for the fabrication process following the tooth impression, and the waiting time for the model to be produced could delay the surgical schedule. Moreover, the impression-taking process causes significant discomfort for the patient, and there were issues where accurate surgery was difficult if the model differed even slightly from the actual oral structure.

[0005] Accordingly, reliance on the surgeon's experience and senses is often required, which can lead to reduced accuracy and consistency, and there are also risk factors such as nerve damage. The present invention aims to provide a method, device, and system that enable a more precise and safe procedure by utilizing 3D CT and augmented reality (AR) technologies to provide a surgical guide in real-time during the implant surgery process.

[0006] Through the present invention, the surgeon can visually check the surgical plan based on a 3D virtual model and compare the surgical guidelines and the patient's oral condition in real time using augmented reality, thereby improving the accuracy and efficiency of the surgery.

[0007] Therefore, a step-by-step guide method, device, and system for dental implant surgery using 3D CT and augmented reality are required. The problem to be solved

[0009] The embodiments relate to a method, device, and system for guiding dental implant surgery steps using 3D CT and augmented reality. means of solving the problem

[0011] According to one embodiment, a step-by-step guide method for dental implant surgery using 3D CT and augmented reality, performed by a device, may include: a step of analyzing a patient's oral 3D CT scan data to establish an implant surgery plan according to a preset surgical plan establishment standard; a step of determining the implant placement location, drilling path, and surgical method according to a preset standard based on the set surgical plan; a step of converting the patient's oral structure into a 3D virtual model based on the patient's oral 3D CT scan data and generating a surgical guideline according to a preset standard based on the converted model; a step of outputting the generated guideline so that the surgeon can view it in real time through the surgeon's augmented reality (AR) terminal; a step of detecting the implant position and drilling angle in real time during the implant placement process and comparing the detected values ​​with a preset standard; a step of detecting the surgeon's movements through the surgeon's augmented reality terminal and comparing the detected movements with a preset standard to output a warning to the augmented reality terminal; and a step of analyzing the patient's oral 3D CT re-scan data to evaluate the implant alignment status after the implant insertion is completed.

[0012] The step of generating the above surgical guideline may include: analyzing the patient's oral 3D CT scan data to extract the anatomical structure, nerve and blood vessel locations of the implant surgery site; analyzing surgical risk factors by comparing the extracted data with preset risk analysis criteria; analyzing jawbone density and gum condition, and determining the implant size and type by comparing the analyzed data with preset implant selection criteria; converting the expected implant placement location in the patient's oral cavity into a 3D model; determining the implant placement location and direction by comparing the converted model with preset placement review criteria; providing real-time guidance to the surgeon's augmented reality terminal by comparing the drilling depth, angle, and implant insertion path with preset criteria; and detecting the surgeon's hand position, angle, and movement speed through the surgeon's augmented reality terminal, and adjusting the working range by comparing the detected data with preset workspace criteria.

[0013] The step of detecting the surgeon's movements and outputting a warning through the surgeon's augmented reality terminal may include: detecting the surgeon's hand tremor using a sensor and image analysis module of the surgeon's augmented reality terminal and generating a first warning if the detected value exceeds a preset allowable range; measuring drilling speed and pressure and generating a second warning if the measured value exceeds a preset threshold; measuring the implant insertion depth in real time and generating a third warning if the measured value differs from a preset target value; detecting the surgeon's position data and comparing the detected data with a preset position standard to generate a fourth warning if the surgeon deviates from the guideline; analyzing a 3D image captured in real time to evaluate the implant alignment status and generating a fifth warning if the evaluated result exceeds a preset allowable error; and outputting the first to fifth warnings to the surgeon's augmented reality terminal.

[0014] Meanwhile, the effects according to the embodiments are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below. Effects of the invention

[0016] According to one embodiment, surgical guidance can be provided in real time by utilizing 3D CT and augmented reality (AR) technologies, thereby improving the accuracy of the surgeon during the implant placement process.

[0017] According to one embodiment, the patient's oral structure can be converted into a 3D virtual model, and based on this, real-time visual feedback can be provided through an augmented reality terminal, thereby shortening the surgery time compared to the method using a conventional molded model.

[0018] According to one embodiment, the surgeon's hand tremors, drilling speed, and pressure can be detected and a warning output can be generated through an augmented reality terminal, thereby reducing errors that may occur during surgery and minimizing risks such as nerve damage.

[0019] Meanwhile, the effects according to the embodiments are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below. Brief explanation of the drawing

[0021] FIG. 1 is a schematic diagram showing the configuration of a system according to one embodiment. FIG. 2 is a flowchart illustrating a step-by-step guide method for dental implant surgery using 3D CT and augmented reality according to one embodiment. FIG. 3 is a flowchart illustrating the process of generating surgical guidelines according to one embodiment. FIG. 4 is a flowchart illustrating the process of detecting a surgeon's movements and outputting a warning according to one embodiment. FIG. 5 is an example diagram of the configuration of a device according to one embodiment. Specific details for implementing the invention

[0022] Hereinafter, embodiments are described in detail with reference to the attached drawings. However, various modifications may be made to the embodiments, and thus the scope of the patent application is not limited or restricted by these embodiments. It should be understood that all modifications, equivalents, and substitutions to the embodiments are included within the scope of the rights.

[0023] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Accordingly, the embodiments are not limited to the specific disclosed forms, and the scope of this specification includes modifications, equivalents, or substitutions that fall within the technical concept.

[0024] Terms such as "first" or "second" may be used to describe various components, but these terms should be interpreted solely for the purpose of distinguishing one component from another. For example, the first component may be named the second component, and similarly, the second component may be named the first component.

[0025] When it is stated that a component is "connected" to another component, it should be understood that it may be directly connected to or coupled with that other component, or that there may be other components in between.

[0026] The terms used in the embodiments are for illustrative purposes only and should not be interpreted as intended to be limiting. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprising" or "having" are intended to indicate the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0027] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the embodiments pertain. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0028] In addition, when describing with reference to the attached drawings, identical components are assigned the same reference numeral regardless of drawing symbols, and redundant descriptions thereof are omitted. In describing the embodiments, if it is determined that a detailed description of related prior art could unnecessarily obscure the essence of the embodiments, such detailed description is omitted.

[0029] The embodiments can be implemented in various forms of products such as personal computers, laptop computers, tablet computers, smartphones, televisions, smart home appliances, intelligent automobiles, kiosks, and wearable devices.

[0030] FIG. 1 is a schematic diagram showing the configuration of a system according to one embodiment.

[0031] Referring to FIG. 1, a system according to one embodiment may include an augmented reality terminal (100) and a device (200) of a surgeon that can communicate with each other through a communication network.

[0032] First, the communication network can be configured regardless of the mode of communication, such as wired or wireless, and can be implemented in various forms to enable communication between servers and between servers and terminals.

[0033] The augmented reality terminal (100) for the surgeon is an augmented reality (AR)-based terminal worn or used by the surgeon performing dental implant surgery. The augmented reality terminal (100) for the surgeon outputs surgical guidelines generated based on 3D CT scan data in real time and supports the surgeon in performing the surgery more precisely during the implant placement process. In addition, it includes a sensor and an image analysis module to detect the surgeon's hand tremors, drilling speed, and pressure, and performs the function of outputting a visual or auditory warning if the detected data exceeds a preset standard. Through this, the surgeon can correct their movements in real time and receive assistance in performing a safer and more precise surgery.

[0034] For example, the augmented reality terminal (100) of the surgeon may be an augmented reality (AR) smart glass, head-mounted display (HMD), or tablet-type device worn by the surgeon, and may be adopted differently depending on the embodiment. The augmented reality terminal (100) of the surgeon displays surgical guidelines generated based on 3D CT data in real time and can intuitively provide information such as implant placement location, drilling path, and angle through an augmented reality interface within the surgeon's field of view. In addition, it includes sensor and image analysis functions to detect the surgeon's hand tremors, drilling speed, and pressure, and can output a visual or auditory warning if the detected data exceeds a preset standard. Through this, the surgeon can monitor their movements in real time and perform a more precise and safe surgery.

[0035] The augmented reality terminal (100) of the surgeon may be configured to perform all or part of the computational functions, storage / reference functions, input / output functions, and control functions of a conventional computer. The augmented reality terminal (100) of the surgeon may be configured to communicate with the device (200) via wired or wireless means.

[0036] The augmented reality terminal (100) of the surgeon may be connected to a website operated by a person or organization providing services using the device (200), or may have an application developed and distributed by a person or organization providing services using the device (200) installed. The augmented reality terminal (100) of the surgeon may be linked with the device (200) through the website or application.

[0037] The augmented reality terminal (100) of the surgeon can access the device (200) through a web page, application, etc. provided by the device (200).

[0038] The device (200) may be a private server owned by a person or organization providing a service using the device (200), a cloud server, or a peer-to-peer (P2P) set of distributed nodes. The device (200) may be configured to perform all or part of the computational functions, storage / reference functions, input / output functions, and control functions that a conventional computer possesses.

[0039] The device (200) may be configured to communicate wirelessly or via wired connection with the surgeon's augmented reality terminal (100), and the process of providing a step-by-step guide for dental implant surgery using 3D CT and augmented reality may be carried out through a server including a processor. The service may be provided via a web-based or smartphone application, and in some cases, processing may be performed by applying an artificial neural network or machine learning.

[0040] Additionally, the device (200) can communicate wirelessly or via wired connection with websites including social media platforms such as blogs, cafes, Instagram, Facebook, Twitter, and YouTube, and web pages including articles, and the device (200) can access the websites to obtain information.

[0041] Meanwhile, for convenience of explanation, only one augmented reality terminal (100) of the surgeon is shown in FIG. 1 and the following description, but the number of terminals can vary depending on the embodiment. As long as the processing capacity of the device (200) allows, there is no particular limit to the number of terminals.

[0042] FIG. 2 is a flowchart illustrating a step-by-step guide method for dental implant surgery using 3D CT and augmented reality according to one embodiment.

[0043] Referring to FIG. 2, first, in step S201, the device (200) can analyze the patient's oral 3D CT scan data and set an implant surgery plan according to pre-set surgical plan establishment criteria.

[0044] That is, the device (200) can receive the patient's oral 3D CT scan data, analyze it, and automatically establish an implant surgery plan.

[0045] For example, the device (200) can detect the density, thickness, nerve and blood vessel locations of the alveolar bone in CT data and perform an analysis by comparing them with preset surgical planning criteria.

[0046] At this time, the device (200) can set up a surgical plan by determining that if the density of the alveolar bone is 800 HU (Hounsfield Unit) or higher, immediate implant placement is possible, and if it is less than 400 HU, bone grafting is considered first.

[0047] Additionally, the device (200) can set up a surgical plan so that the implant is at least 2 mm away from the nerve canal, and if the thickness of the alveolar bone is less than 5 mm, it can recommend an implant with a smaller diameter (e.g., Ø).

[0048] Through this, the device (200) can automatically set an optimized implant surgery plan based on the patient's anatomical information, thereby enabling a more precise and safe procedure.

[0049] In step S202, the device (200) can determine the implant placement location, drilling path, and surgical method according to preset criteria based on the set surgical plan.

[0050] That is, the device (200) can automatically determine the optimal implant placement location, drilling depth, and path of the implant based on the set implant surgery plan.

[0051] The device (200) can compare pre-set implant guidelines with CT data to calculate the exact coordinate values ​​where the implant will be placed and calculate the angle and depth required during the drilling process.

[0052] For example, the device (200) can calculate the optimal implantation position of the implant to X: 12.5mm, Y: 8.3mm, Z: -4.0mm and adjust the drilling angle to 15° to prevent nerve damage.

[0053] Additionally, the device (200) can set the drilling depth differently, such as 8mm, 10mm, or 12mm, depending on the condition of the patient's jawbone, and if the bone density is 600HU or less, the drilling speed can be adjusted to 800RPM.

[0054] Through this, the device (200) can increase the success rate of the procedure by automatically determining the optimal implant placement location and drilling path based on objective criteria without relying on the surgeon's senses.

[0055] In step S203, the device (200) can convert the patient's oral structure into a 3D virtual model and generate surgical guidelines based on the converted model according to preset criteria.

[0056] That is, the device (200) can analyze the patient's 3D CT data to convert the internal structure of the oral cavity into a 3D model and automatically generate surgical guidelines based on this.

[0057] The device (200) can generate a 3D model that reflects the shape of the patient's alveolar bone, the location of the nerve canal, the height of the maxillary sinus, etc., and can use the model to generate a guideline that considers the insertion direction, depth, and angle of the implant.

[0058] For example, the device (200) can reconstruct the three-dimensional shape of the alveolar bone based on CT data, automatically recognize the nerve canal, and set guidelines so that the implant is placed at a position more than 2 mm away from the nerve canal.

[0059] Additionally, the device (200) may be adjusted so that when the implant size is Ø×10mm, the insertion direction is set to a 90° right angle, and when it is Ø×12mm, a 10° inclined insertion is required.

[0060] Through this, the device (200) can generate a precise 3D model that reflects the individual anatomical structure of the patient, thereby supporting more accurate and safe implant surgery.

[0061] For a detailed explanation regarding this, refer to Fig. 3.

[0062] In step S204, the device (200) can output the generated guideline so that the surgeon can view it in real time through the surgeon's augmented reality (AR) terminal.

[0063] That is, the device (200) can output the generated implant surgery guideline to the surgeon's augmented reality terminal (100) so that the surgeon can check it in real time.

[0064] The device (200) can display 3D guidelines directly in the surgeon's field of vision through the display of the augmented reality terminal (100) during surgery, and can visualize the expected insertion position of the implant and the drilling path in real time.

[0065] For example, the device (200) can virtually display the accurate insertion path of the implant based on X, Y, and Z coordinates on the display of the augmented reality terminal (100) and output a warning if an error of 0.5 mm or more occurs.

[0066] Additionally, the device (200) may detect the movement of the surgeon and provide a green indicator if the expected position and the actual drilling position are maintained within ±1mm, and a red warning indicator if they deviate by more than 1mm.

[0067] Through this, the device (200) can support the surgeon in more intuitively verifying the accurate insertion position and direction of the implant and performing the surgery while correcting errors in real time.

[0068] In step S205, the device (200) can detect the implant position and drilling angle in real time during the implant placement process and compare the detected values ​​with preset standards.

[0069] That is, the device (200) can detect the position of the implant and the drilling angle in real time during surgery, and evaluate the accuracy by comparing the detected data with a preset standard.

[0070] The device (200) utilizes sensor and image analysis technology to measure the depth, speed, and angle of drilling and can detect in real time whether the implant is being inserted into the planned implantation position.

[0071] For example, the device (200) can generate a warning if an error of ±0.3 mm or more occurs in the implant at the target position, and output a message indicating that adjustment is needed to the surgeon's augmented reality terminal (100) if the drilling angle deviates by ±2° or more from the planned angle.

[0072] Additionally, the device (200) can prevent excessive drilling by automatically providing a warning signal when the drilling depth reaches a target depth (e.g., 10 mm).

[0073] Through this, the device (200) can monitor the implant position and drilling angle in real time to guide the device to avoid deviating from the planned implantation path, thereby enabling more precise implant insertion.

[0074] In step S206, the device (200) can detect the surgeon's movements through the surgeon's augmented reality terminal and output a warning to the augmented reality terminal by comparing the detected movements with a preset standard.

[0075] That is, the device (200) can detect the surgeon's hand tremor, drilling speed, and movement path using the surgeon's augmented reality terminal (100), and compare this with a preset standard to maintain precision.

[0076] The device (200) tracks the movements of the surgeon based on real-time video analysis and sensor data, and can induce correction by outputting a warning if an error exceeding a certain range occurs.

[0077] For example, the device (200) can output a ‘hand tremor warning’ message to the surgeon’s augmented reality terminal (100) when hand tremor of 0.5 mm or more is detected, and can provide a warning to adjust the speed if the drilling speed exceeds 1000 RPM.

[0078] Additionally, the device (200) may immediately generate an auditory warning if the surgeon shows movement of ±1mm or more away from the preset implantation path.

[0079] Through this, the device (200) can detect errors that may occur during surgery in real time and provide immediate feedback, thereby enabling more precise and safer surgery.

[0080] For a detailed explanation regarding this, please refer to Fig. 4.

[0081] In step S207, the device (200) can evaluate the implant alignment status by analyzing the patient's oral 3D CT rescan data after the implant insertion is completed.

[0082] That is, the device (200) can scan the patient's oral cavity again with 3D CT after the implant is inserted and analyze it to evaluate whether the implant has been accurately inserted in the planned position.

[0083] The device (200) can analyze the alignment status by comparing the implant coordinates set in the initial surgical plan with the actual inserted coordinates, and can provide additional correction guides if necessary.

[0084] For example, the device (200) can determine that the insertion is normal if the error between the initially planned insertion coordinates (X: 12.5mm, Y: 8.3mm, Z: -4.0mm) and the actual inserted coordinates is within ±0.5mm, and output a 'alignment correction required' message if it exceeds ±0.5mm.

[0085] Additionally, the device (200) can provide a notification that post-operative correction is required if the angle of the implant (e.g., 15°) differs from the planned angle by more than ±2°.

[0086] Through this, the device (200) can verify the exact position of the implant after surgery and support the performance of correction work if necessary, thereby ensuring a more perfect surgical result.

[0087] That is, the device (200) can automatically establish a surgical plan based on the patient's 3D CT data, calculate the optimal implantation location and drilling path, and generate a 3D guideline to output in real time to the surgeon's augmented reality terminal (100).

[0088] In addition, by detecting the implant position, drilling angle, and surgeon's movements in real time during the surgical process and providing immediate feedback by comparing them with preset standards, more precise and safer implant surgery can be performed.

[0089] FIG. 3 is a flowchart illustrating the process of generating surgical guidelines according to one embodiment.

[0090] Referring to FIG. 3, first, in step S301, the device (200) can analyze the patient's oral 3D CT scan data to extract the anatomical structure, nerve and blood vessel locations of the implant surgery site.

[0091] That is, the device (200) can automatically extract the anatomical structure of the implant site by analyzing the patient's 3D CT data.

[0092] The device (200) can recognize major anatomical elements such as nerve canals, blood vessel distribution, and maxillary sinus, and analyze structural features to reflect them in a surgical plan.

[0093] For example, the device (200) can use CT scan data to automatically detect the area where the nerve canal is located and visually highlight the path of the nerve canal in a 3D model. In addition, it can detect areas with a dense distribution of blood vessels and set guidelines to maintain a safety distance of at least 3 mm from such areas.

[0094] Through this, the device (200) can reduce the risk of nerve and blood vessel damage during implant surgery and support safe implantation.

[0095] In step S302, the device (200) can analyze surgical risk factors by comparing the extracted data with preset risk analysis criteria.

[0096] That is, the device (200) can evaluate risk factors that may occur during the implant placement process by comparing the extracted anatomical data with preset risk analysis criteria.

[0097] The device (200) can analyze the difficulty of the surgery based on the implant location, the relative distance from the nerve canal, blood vessel, and maxillary sinus, and the density and thickness of the alveolar bone.

[0098] For example, the device (200) can output a ‘risk of nerve damage’ if the implant position is within 2 mm of the nerve canal, and generate a ‘risk of maxillary sinus perforation’ if the distance from the maxillary sinus mucosa is less than 1 mm.

[0099] Additionally, the device (200) may output a ‘bone graft needed’ warning if the density of the alveolar bone is less than 400HU, and provide a notification that bone expansion is needed in the long axis direction if the thickness of the bone is 5mm or less.

[0100] Through this, the device (200) can support the surgeon in identifying risk factors in advance and establishing a safer plan during the pre-operative stage.

[0101] In step S303, the device (200) can analyze jawbone density and gum condition and determine the implant size and type by comparing the analyzed data with preset implant selection criteria.

[0102] That is, the device (200) can analyze the patient's jawbone density and gum thickness and determine the optimal implant size and type by comparing them with preset implant selection criteria.

[0103] The device (200) can calculate to recommend a longer implant or a wider implant in cases where bone density is low or gum thickness is insufficient.

[0104] For example, the device (200) may recommend an implant of size Ø×10mm if the density of the alveolar bone is 600HU or more, and an implant of size Ø×12mm if the density is less than 400HU. Additionally, if the gum thickness is 3mm or less, it may be configured to select an implant with a wide upper platform to protect the gums.

[0105] Through this, the device (200) can automatically select the optimal type of implant by reflecting the patient's bone condition and gum characteristics, thereby increasing the success rate of the surgery.

[0106] In step S304, the device (200) can convert the expected placement location of the implant in the patient's oral cavity into a 3D model.

[0107] That is, the device (200) can convert the patient's oral structure into a 3D model based on CT data and simulate the expected implantation location of the implant in the model.

[0108] The device (200) can model a virtual implant placement state by taking into account the inclination of the alveolar bone, anatomical structure, and the arrangement of surrounding teeth.

[0109] For example, the device (200) can reconstruct the alveolar bone in 3D from CT data, place the implant at X: 12.5mm, Y: 8.3mm, Z: -4.0mm, and reflect the expected implantation direction and angle in the 3D model.

[0110] Additionally, the device (200) may perform a simulation to adjust the implant direction to provide an optimal force distribution by taking into account the direction and balance of the patient's chewing force.

[0111] Through this, the device (200) can generate a 3D model that reflects the patient's anatomical structure, thereby supporting the establishment of a more precise surgical plan.

[0112] In step S305, the device (200) can determine the implant placement location and direction by comparing the converted model with preset placement review criteria.

[0113] That is, the device (200) can determine the optimal implantation position and direction by comparing the expected placement of implants generated from a 3D model with a preset standard.

[0114] The device (200) can compare the angle of the implant, insertion depth, distance from the nerve canal, etc., and check whether the set criteria are satisfied.

[0115] For example, the device (200) can output a ‘angle adjustment needed’ warning if the insertion angle of the implant is tilted more than 10°, and guide the user to correct the position if the distance from the nerve canal is less than 1.5mm.

[0116] Additionally, the device (200) may provide a warning that adjustment is needed for tooth balance if the gap between implants is less than 3 mm.

[0117] Through this, the device (200) can perform a placement review in advance to determine the optimal implantation location and increase the success rate of the surgery.

[0118] In step S306, the device (200) can provide real-time guidance to the surgeon's augmented reality terminal by comparing the drilling depth, angle, and implant insertion path with preset standards.

[0119] That is, the device (200) can detect the drilling depth, angle, and insertion path in real time during surgery and compare them with preset standards to provide guidance to the surgeon's augmented reality terminal (100).

[0120] For example, the device (200) can output an 'angle adjustment needed' warning to the augmented reality terminal (100) if the drilling angle deviates by more than ±2° from the planned angle, and can prevent excessive drilling by providing vibration feedback when the drilling depth reaches a target of 10mm.

[0121] Through this, the device (200) can support the surgeon in performing a more precise procedure by providing real-time guidance.

[0122] In step S307, the device (200) can detect the surgeon's hand position, angle, and movement speed through the surgeon's augmented reality terminal, and adjust the work range by comparing the detected data with a preset workspace standard.

[0123] That is, the device (200) can utilize the sensor and image analysis functions mounted on the surgeon's augmented reality terminal (100) to detect the surgeon's hand position, drilling angle, and movement speed, and adjust the working range by comparing this with a preset standard.

[0124] The device (200) can track movement in real time so that the surgeon does not move out of the planned workspace when implanting the implant, and can provide a correction guide if necessary.

[0125] For example, the device (200) can display a visual warning on the augmented reality terminal (100) if the position of the surgeon's hand deviates by more than ±2mm from the planned workspace, and output an auditory warning if it deviates by more than ±3mm.

[0126] Additionally, the device (200) may provide feedback to reduce speed if the operator performs drilling too quickly and exceeds 2000 RPM, and may output a 'proceed slowly' instruction if the movement speed is more than 1.5 times faster than the planned speed.

[0127] Through this, the device (200) can adjust the working range in real time so that the surgeon can perform implant placement more stably, thereby increasing accuracy and safety.

[0128] That is, the device (200) can analyze anatomical structures based on 3D CT data, evaluate risk factors, and automatically determine the optimal implant size and placement.

[0129] In addition, by providing real-time guidance to the surgeon's augmented reality terminal (100) based on the converted 3D model and detecting the surgeon's hand position, angle, and movement speed to adjust the working range, it is possible to enable more precise and safe implant surgery.

[0130] FIG. 4 is a flowchart illustrating the process of detecting a surgeon's movements and outputting a warning according to one embodiment.

[0131] Referring to FIG. 4, first, in step S401, the device (200) can detect hand tremors of the surgeon using the sensor and image analysis module of the surgeon's augmented reality terminal, and generate a first warning if the detected value exceeds a preset allowable range.

[0132] That is, the device (200) can detect the surgeon's hand tremors in real time by utilizing the sensor and image analysis module included in the surgeon's augmented reality terminal (100), and generate a warning if the detected value exceeds a preset allowable range.

[0133] The device (200) measures the amplitude and frequency of hand tremors and can analyze whether minute hand tremors during surgery affect the accuracy of implant placement.

[0134] For example, the device (200) can determine that the hand tremor of the surgeon is normal if it is 0.3 mm or less, output a 'caution' message if it is 0.3 mm to 0.5 mm, and output a 'hand tremor warning' visually and audibly to the augmented reality terminal (100) if it is 0.5 mm or more.

[0135] Additionally, if hand tremors are continuously detected, the device (200) may provide a message to induce hand stabilization training or guide the surgeon to control their hand more precisely by utilizing vibration feedback.

[0136] Through this, the device (200) can detect the surgeon's hand tremors and provide real-time feedback, thereby enabling more precise implant placement.

[0137] In step S402, the device (200) measures the drilling speed and pressure, and can generate a second warning if the measured value exceeds a preset threshold.

[0138] That is, the device (200) can measure the drilling speed and pressure in real time during surgery and, if the set criteria are exceeded, generate a warning and output it to the surgeon's augmented reality terminal (100).

[0139] The device (200) can analyze whether drilling is proceeding at an appropriate speed and control it so that damage to the alveolar bone does not occur due to excessive pressure.

[0140] For example, the device (200) determines that the drilling speed is normal when it is 800 to 1200 RPM, outputs a 'speed adjustment needed' warning when it exceeds 1200 RPM, and outputs a warning to induce an immediate speed reduction when it exceeds 2000 RPM.

[0141] Additionally, the device (200) may determine that it is normal if the drilling pressure is 3N or less, and provide a 'pressure caution' message if it is 3N to 5N, and a 'pressure overload warning' if it is 5N or more.

[0142] Through this, the device (200) can support safe and precise implant placement by preventing the surgeon from applying excessive speed or pressure.

[0143] In step S403, the device (200) measures the implant insertion depth in real time and can generate a third warning if the measured value differs from a preset target value.

[0144] That is, the device (200) can measure the implant insertion depth in real time and generate a warning if it exceeds a certain standard compared to the planned target depth.

[0145] The device (200) can check whether the drilling has accurately reached the set depth and provide feedback to correct it in real time if necessary.

[0146] For example, if the target insertion depth is 10 mm, the device (200) determines that it is normal if the insertion depth is within the range of 9.5 mm to 10.5 mm, and outputs a 'insertion depth adjustment needed' warning if it is less than 9.5 mm or exceeds 10.5 mm.

[0147] In addition, the device (200) may automatically generate a warning if the implant is inserted more than 1 mm deeper than the planned depth to prevent additional damage.

[0148] Through this, the device (200) guides the implant to be inserted to an accurate depth, thereby increasing the precision of the surgery and preventing complications.

[0149] In step S404, the device (200) detects the surgeon's position data and compares the detected data with a preset position standard to generate a fourth warning if the surgeon deviates from the guideline.

[0150] That is, the device (200) can detect the surgeon's real-time location data and generate a warning when the surgeon leaves the set workspace and output it to the augmented reality terminal (100).

[0151] The device (200) can provide correction feedback so that the surgeon can work accurately at the planned position.

[0152] For example, the device (200) determines that it is normal if the surgeon's hand is within ±2mm of the set workspace, outputs a 'caution' message if it is between ±2mm and 3mm, and outputs a 'position deviation warning' if it is more than ±3mm away.

[0153] Additionally, the device (200) may generate a warning if the surgeon deviates by more than 5° from a preset angle (e.g., 90°) and guide the surgeon to adjust the angle.

[0154] Through this, the device (200) can support the surgeon in performing a more accurate surgery by providing real-time feedback so that the surgeon does not deviate from the planned position.

[0155] In step S405, the device (200) analyzes a 3D image captured in real time to evaluate the implant alignment status, and if the evaluated result exceeds a preset tolerance, it may generate a fifth warning.

[0156] That is, the device (200) can analyze a 3D image taken in real time during surgery to evaluate whether the implant has been accurately inserted at the planned position and angle.

[0157] The device (200) can compare the alignment state of the actual inserted implant with the planned position and output a warning if the error exceeds a set range.

[0158] For example, the device (200) can determine that the alignment angle of the implant is normal if it is within ±2° of the target value, provide a ‘alignment adjustment needed’ warning if it is between ±2° and 3°, and provide an ‘alignment error warning’ if it deviates by more than ±3°.

[0159] Additionally, the device (200) may output a notice indicating that alignment correction is required if, as a result of 3D analysis after implant insertion, the alignment deviates by more than 0.5 mm from the target coordinates.

[0160] Through this, the device (200) can verify in real time that the implant maintains the planned position and alignment state, thereby supporting the achievement of more precise results.

[0161] In step S406, the device (200) can output the first to fifth warnings to the surgeon's augmented reality terminal.

[0162] That is, the device (200) can output all warning information occurring during surgery to the surgeon's augmented reality terminal (100) in real time, thereby guiding the surgeon to take immediate action.

[0163] For example, the device (200) can provide each warning as a visual signal (e.g., a red warning indicator) or auditory feedback (e.g., a vibration notification) so that the operator can quickly recognize it.

[0164] Through this, the device (200) enables the surgeon to receive real-time feedback, thereby enabling more precise and safe implant surgery.

[0165] That is, the device (200) can improve the precision of implant placement and increase the safety of the surgery by detecting the surgeon's movements in real time during surgery and providing an immediate warning by comparing them with preset standards.

[0166] FIG. 5 is an example diagram of the configuration of a device according to one embodiment.

[0167] A device (200) according to one embodiment includes a processor (210) and a memory (220). A device (200) according to one embodiment may be the server or terminal described above. The processor (210) may include at least one device described above through FIGS. 1 to 4 or perform at least one method described above through FIGS. 1 to 4. The memory (220) may store information related to the method described above or store a program in which the method described above is implemented. The memory (220) may be volatile memory or non-volatile memory.

[0168] The processor (210) can execute a program and control the device (200). The code of the program executed by the processor (210) can be stored in memory (220). The device (200) can be connected to an external device (e.g., a personal computer or a network) through an input / output device (not shown in the drawing) and exchange data.

[0169] The embodiments described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are also possible.

[0170] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiment, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0171] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0172] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0173] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below. Explanation of the symbols

[0175] 100: Surgeon's Augmented Reality Terminal 200: Device 210: Processor 220: Memory

Claims

Claim 1 A method for guiding dental implant surgery step-by-step using 3D CT and augmented reality, performed by a device, comprising: a step of analyzing a patient's oral 3D CT scan data to establish an implant surgery plan according to preset surgical planning criteria; a step of determining the implant placement location, drilling path, and surgical method according to preset criteria based on the established surgical plan; a step of converting the patient's oral structure into a 3D virtual model based on the patient's oral 3D CT scan data and generating surgical guidelines according to preset criteria based on the converted model; a step of outputting the generated guidelines so that the surgeon can view them in real time through the surgeon's augmented reality (AR) terminal; a step of detecting the implant position and drilling angle in real time during the implant placement process and comparing the detected values ​​with preset criteria; a step of detecting the surgeon's movements through the surgeon's augmented reality terminal and comparing the detected movements with preset criteria to output a warning to the augmented reality terminal; and a step of analyzing the patient's oral 3D CT re-scan data to evaluate the implant alignment status after the implant insertion is completed. Claim 2 In claim 1, the step of generating the surgical guideline comprises: a step of extracting the anatomical structure, nerve and blood vessel locations of the implant surgery site by analyzing the patient's oral 3D CT scan data; a step of analyzing surgical risk factors by comparing the extracted data with preset risk analysis criteria; a step of analyzing jawbone density and gum condition and determining the implant size and type by comparing the analyzed data with preset implant selection criteria; a step of converting the expected implant placement location in the patient's oral cavity into a 3D model; a step of determining the implant placement location and direction by comparing the converted model with preset placement review criteria; a step of providing real-time guidance to the surgeon's augmented reality terminal by comparing the drilling depth, angle, and implant insertion path with preset criteria; and a step of detecting the surgeon's hand position, angle, and movement speed through the surgeon's augmented reality terminal and adjusting the working range by comparing the detected data with preset workspace criteria, thereby providing a step-by-step guide for dental implant surgery using 3D CT and augmented reality. Claim 3 A method for guiding dental implant surgery steps using 3D CT and augmented reality, wherein the step of detecting the surgeon's movements through the surgeon's augmented reality terminal and outputting a warning comprises: a step of detecting the surgeon's hand tremor using a sensor and image analysis module of the surgeon's augmented reality terminal and generating a first warning if the detected value exceeds a preset allowable range; a step of measuring drilling speed and pressure and generating a second warning if the measured value exceeds a preset threshold; a step of measuring the implant insertion depth in real time and generating a third warning if the measured value differs from a preset target value; a step of detecting the surgeon's position data and generating a fourth warning if the surgeon deviates from the guideline by comparing the detected data with a preset position reference; a step of analyzing a 3D image captured in real time to evaluate the implant alignment status and generating a fifth warning if the evaluated result exceeds a preset allowable error; and a step of outputting the first to fifth warnings to the surgeon's augmented reality terminal.

Images